-- Logs begin at Sun 2022-09-04 00:10:31 UTC, end at Sun 2022-09-04 01:26:56 UTC. -- Sep 04 00:56:25.231739 dv-cinder-master-3-iscsi systemd[1]: Started Devstack devstack@q-agt.service. Sep 04 00:56:27.814060 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.common.config [-] Logging enabled! Sep 04 00:56:27.814633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.common.config [-] /usr/local/bin/neutron-openvswitch-agent version 20.1.0.dev538 Sep 04 00:56:27.814866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-openvswitch-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=107812) setup_logging /opt/stack/neutron/neutron/common/config.py:123}} Sep 04 00:56:27.815332 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO os_ken.base.app_manager [-] loading app neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_oskenapp Sep 04 00:56:28.302381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO keyring.backend [-] Loading KWallet Sep 04 00:56:28.318519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO keyring.backend [-] Loading SecretService Sep 04 00:56:28.322010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO keyring.backend [-] Loading Windows Sep 04 00:56:28.322010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO keyring.backend [-] Loading chainer Sep 04 00:56:28.322010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO keyring.backend [-] Loading macOS Sep 04 00:56:28.971090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=107812) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 04 00:56:28.971643 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=107812) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 04 00:56:28.971745 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=107812) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 04 00:56:28.973033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=107812) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 04 00:56:28.973357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=107812) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 04 00:56:28.973688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=107812) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 04 00:56:29.032475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=107812) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 04 00:56:29.033145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=107812) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 04 00:56:29.033614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=107812) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 04 00:56:29.046703 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=107812) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 04 00:56:29.047333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=107812) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 04 00:56:29.047799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=107812) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 04 00:56:29.073638 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=107812) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 04 00:56:29.073932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=107812) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 04 00:56:29.074202 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=107812) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 04 00:56:29.110765 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=107812) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 04 00:56:29.111062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=107812) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 04 00:56:29.111324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=107812) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 04 00:56:29.309596 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO os_ken.base.app_manager [-] loading app os_ken.app.ofctl.service Sep 04 00:56:29.310632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO os_ken.base.app_manager [-] loading app os_ken.controller.ofp_handler Sep 04 00:56:29.311620 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO os_ken.base.app_manager [-] instantiating app neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_oskenapp of OVSNeutronAgentOSKenApp Sep 04 00:56:29.312065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO os_ken.base.app_manager [-] instantiating app os_ken.app.ofctl.service of OfctlService Sep 04 00:56:29.312492 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO os_ken.base.app_manager [-] instantiating app os_ken.controller.ofp_handler of OFPHandler Sep 04 00:56:29.313759 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: Open vSwitch agent after_init 55550000 {{(pid=107812) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 04 00:56:29.314912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.agent_extensions_manager [-] Loaded agent extensions: [] Sep 04 00:56:29.315230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ******************************************************************************** {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 04 00:56:29.315389 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] Configuration options gathered from: {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 04 00:56:29.315649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 04 00:56:29.315895 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 04 00:56:29.316046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ================================================================================ {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 04 00:56:29.316480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] agent_down_time = 75 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.316734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] allow_bulk = True {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.316989 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] api_extensions_path = {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.317273 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] api_paste_config = api-paste.ini {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.317529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] auth_strategy = keystone {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.317779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] backlog = 4096 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.318030 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] base_mac = fa:16:3e:00:00:00 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.318304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] bind_host = 0.0.0.0 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.320647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] bind_port = 9696 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.320920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] client_socket_timeout = 900 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.321428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] config_dir = [] {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.321609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.321942 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] config_source = [] {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.322230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] control_exchange = neutron {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.322424 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] core_plugin = ml2 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.322650 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] debug = True {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.322886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] default_availability_zones = [] {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.323286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.324470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] dhcp_agent_notification = True {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.324713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] dhcp_lease_duration = 86400 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.324991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] dhcp_load_type = networks {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.325273 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] dns_domain = openstacklocal {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.325716 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] enable_new_agents = True {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.326046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] enable_traditional_dhcp = True {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.326219 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] external_dns_driver = None {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.326545 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] filter_validation = True {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.326726 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] global_physnet_mtu = 1500 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.326974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] host = dv-cinder-master-3-iscsi {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.327233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] http_retries = 3 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.327454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] instance_format = [instance: %(uuid)s] {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.327711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.327952 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ipam_driver = internal {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.328176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ipv6_pd_enabled = False {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.328397 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] log_config_append = None {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.328645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.329095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] log_dir = None {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.329352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] log_file = None {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.330071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] log_rotate_interval = 1 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.330071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] log_rotate_interval_type = days {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.330071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] log_rotation_type = none {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.330379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.330485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.330646 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.330894 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.331143 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.331381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] max_dns_nameservers = 5 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.331616 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] max_header_line = 16384 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.331850 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] max_logfile_count = 30 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.332086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] max_logfile_size_mb = 200 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.332328 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] max_subnet_host_routes = 20 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.332538 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] network_link_prefix = None {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.332782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] notify_nova_on_port_data_changes = True {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.333026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] notify_nova_on_port_status_changes = True {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.333337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] pagination_max_limit = -1 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.333572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] publish_errors = False {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.333805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] rate_limit_burst = 0 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.334049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] rate_limit_except_level = CRITICAL {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.334281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] rate_limit_interval = 0 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.334520 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] retry_until_window = 30 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.334748 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] rpc_resources_processing_step = 20 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.334980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] rpc_response_max_timeout = 600 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.335212 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] send_events_interval = 2 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.335516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.335707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] setproctitle = on {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.335952 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] state_path = /opt/stack/data/neutron {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.336196 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] syslog_log_facility = LOG_USER {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.336428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] tcp_keepidle = 600 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.336670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] transport_url = **** {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.336904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] use_eventlog = False {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.337173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] use_journal = False {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.337940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] use_json = False {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.338178 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] use_ssl = False {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.338415 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] use_stderr = False {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.338748 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] use_syslog = False {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.338915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] vlan_transparent = False {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.339112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] watch_log_file = False {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.339346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] wsgi_default_pool_size = 100 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.339577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] wsgi_keep_alive = True {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.339824 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.340056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] wsgi_server_debug = False {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 00:56:29.340316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_concurrency.disable_process_locking = False {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.340576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.340835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.connection_string = messaging:// {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.341118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.enabled = False {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.341367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.es_doc_type = notification {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.341612 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.es_scroll_size = 10000 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.341859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.es_scroll_time = 2m {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.342097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.filter_error_trace = False {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.342350 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.hmac_keys = SECRET_KEY {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.342597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.sentinel_service_name = mymaster {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.342855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.socket_timeout = 0.1 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.343097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.trace_sqlalchemy = False {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.343358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.enforce_new_defaults = False {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.343612 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.enforce_scope = False {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.343870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.policy_default_rule = default {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.344142 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.344395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.344647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.344882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.351541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.351541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.351541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.351541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.351541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.351541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_metrics.metrics_process_name = {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.351541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.352462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.352462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.352462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.arp_responder = False {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.352462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.baremetal_smartnic = False {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.352462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.dont_fragment = True {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.352462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.drop_flows_on_start = False {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.352462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.dscp = None {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.353439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.dscp_inherit = False {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.353439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.enable_distributed_routing = False {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.353439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.explicitly_egress_direct = False {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.353439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.l2_population = False {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.353439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.log_agent_heartbeats = False {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.353439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.minimize_polling = True {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.353439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.ovsdb_monitor_respawn_interval = 30 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.354376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.polling_interval = 2 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.354376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.quitting_rpc_timeout = 10 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.354376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.report_interval = 30.0 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.354376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.354376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.354376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.tunnel_csum = False {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.354376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.tunnel_types = [] {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.355344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.use_helper_for_ns_read = True {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.355344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.veth_mtu = 9000 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.355344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.vxlan_udp_port = 4789 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.355344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.bridge_mac_table_size = 50000 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.355344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.bridge_mappings = ['physnet1:br-data'] {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.355344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.datapath_type = system {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.355344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.igmp_snooping_enable = False {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.360734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.int_peer_patch_port = patch-tun {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.360734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.integration_bridge = br-int {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.360734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.local_ip = None {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.360734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.of_connect_timeout = 300 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.360734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.of_inactivity_probe = 10 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.360734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.of_listen_address = 127.0.0.1 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.360734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.of_listen_port = 6633 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.361688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.of_request_timeout = 300 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.361688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.openflow_processed_per_port = False {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.361688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.ovsdb_connection = tcp:127.0.0.1:6640 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.361688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.ovsdb_debug = False {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.361688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.ovsdb_timeout = 10 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.361688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.resource_provider_bandwidths = [] {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.361688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.resource_provider_default_hypervisor = None {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.362606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.resource_provider_hypervisors = {} {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.362606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.resource_provider_inventory_defaults = {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0} {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.362606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.resource_provider_packet_processing_inventory_defaults = {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0} {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.362606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.resource_provider_packet_processing_with_direction = [] {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.362606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.resource_provider_packet_processing_without_direction = [] {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.362606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.ssl_ca_cert_file = None {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.363379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.ssl_cert_file = None {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.363379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.ssl_key_file = None {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.363379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.tun_peer_patch_port = patch-int {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.363379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.tunnel_bridge = br-tun {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.363379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.vhostuser_socket_dir = /var/run/openvswitch {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.363379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] DHCP.dhcp_rebinding_time = 0 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.363379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] DHCP.dhcp_renewal_time = 0 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.364285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] DHCP.enable_ipv6 = True {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.364285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] LOCAL_IP.static_nat = False {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.364285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.auth_section = None {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.364285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.auth_type = password {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.364285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.364285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.certfile = None {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.364285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.collect_timing = False {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.365231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.endpoint_type = public {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.365231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.insecure = False {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.365231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.keyfile = None {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.365231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.region_name = RegionOne {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.365231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.split_loggers = False {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.365231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.timeout = None {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.365231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.auth_section = None {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.366260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.auth_type = password {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.366260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.366260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.certfile = None {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.366260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.collect_timing = False {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.366260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.endpoint_type = public {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.366889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.insecure = False {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.366889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.keyfile = None {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.366889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.region_name = None {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.367294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.split_loggers = False {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.367294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.timeout = None {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.367568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.auth_section = None {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.367976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.auth_type = None {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.368176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.cafile = None {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.368415 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.certfile = None {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.368753 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.collect_timing = False {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.369123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.connect_retries = None {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.369355 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.connect_retry_delay = None {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.369599 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.enable_notifications = False {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.369987 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.endpoint_override = None {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.370090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.insecure = False {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.370300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.interface = None {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.370533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.keyfile = None {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.370769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.max_version = None {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.371042 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.min_version = None {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.371273 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.region_name = None {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.371505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.service_name = None {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.371737 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.service_type = None {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.371974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.split_loggers = False {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.372206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.status_code_retries = None {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.372438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.status_code_retry_delay = None {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.372671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.timeout = None {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.372904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.valid_interfaces = None {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.373170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.version = None {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.373418 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] cli_script.dry_run = False {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.373679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.373921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.374162 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.374403 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.374639 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.374880 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.375114 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.375451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.375695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.375928 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.376185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.376426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.376675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.376920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.377180 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.377437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.377678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.377921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.378159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.378397 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.378636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.378878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.379115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.379352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.379595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.379836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.ssl = False {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.380090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.380342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.380582 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.380833 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.381131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.ssl_version = {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.381355 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_notifications.driver = [] {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.381595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_notifications.retry = -1 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.381866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.382103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_notifications.transport_url = **** {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.382359 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.382592 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep.group = None {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.382826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep.helper_command = None {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.383070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep.logger_name = oslo_privsep.daemon {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.383309 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep.thread_pool_size = 4 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.383543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep.user = None {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.383787 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.384017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_dhcp_release.group = None {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.384270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_dhcp_release.helper_command = None {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.384513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.384749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.384980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_dhcp_release.user = None {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.385264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.385596 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_ovs_vsctl.group = None {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.385831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_ovs_vsctl.helper_command = None {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.386072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.386308 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.386538 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_ovs_vsctl.user = None {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.386780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_namespace.capabilities = [21] {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.387009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_namespace.group = None {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.387238 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_namespace.helper_command = None {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.387480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.387718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_namespace.thread_pool_size = 4 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.387954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_namespace.user = None {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.388201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_conntrack.capabilities = [12] {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.388436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_conntrack.group = None {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.388670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_conntrack.helper_command = None {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.388912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.389175 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_conntrack.thread_pool_size = 4 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.389408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_conntrack.user = None {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.389654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_link.capabilities = [12, 21] {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.389884 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_link.group = None {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.390113 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_link.helper_command = None {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.390355 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.390594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_link.thread_pool_size = 4 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.390823 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_link.user = None {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.391067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] service_providers.service_provider = [] {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.391310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.391499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] agent.extensions = [] {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.391747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] QUOTAS.default_quota = -1 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.391998 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.392307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] QUOTAS.quota_network = 100 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.392571 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] QUOTAS.quota_port = 500 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.392820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] QUOTAS.quota_rbac_policy = 10 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.393088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] QUOTAS.quota_security_group = 100 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.393348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] QUOTAS.quota_security_group_rule = 100 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.393603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] QUOTAS.quota_subnet = 100 {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.393846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] QUOTAS.track_quota_usage = True {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.394092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] SECURITYGROUP.enable_ipset = True {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.394344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] SECURITYGROUP.enable_security_group = True {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.394595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.394843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 00:56:29.395020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ******************************************************************************** {{(pid=107812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 04 00:56:29.462596 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Flow_Table.name {{(pid=107812) autocreate_indices /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:85}} Sep 04 00:56:29.462596 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Mirror.name {{(pid=107812) autocreate_indices /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:85}} Sep 04 00:56:29.462917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Bridge.name {{(pid=107812) autocreate_indices /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:104}} Sep 04 00:56:29.463027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Port.name {{(pid=107812) autocreate_indices /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:104}} Sep 04 00:56:29.463234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Interface.name {{(pid=107812) autocreate_indices /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:104}} Sep 04 00:56:29.463433 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Manager.target {{(pid=107812) autocreate_indices /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:104}} Sep 04 00:56:29.532946 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(name=br-int, may_exist=True, datapath_type=system) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 00:56:29.533352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbAddCommand(table=Bridge, record=br-int, column=protocols, values=('OpenFlow14', 'OpenFlow13', 'OpenFlow10')) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 00:56:29.534245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(table=Bridge, record=br-int, col_values=(('other_config', {'mac-table-size': '50000'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 00:56:29.542316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): SetFailModeCommand(bridge=br-int, mode=secure) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 00:56:29.552269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_bridge [-] Setting controller tcp:127.0.0.1:6633 for bridge br-int. {{(pid=107812) setup_controllers /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ovs_bridge.py:80}} Sep 04 00:56:29.552843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): SetControllerCommand(bridge=br-int, targets=['tcp:127.0.0.1:6633']) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 00:56:30.570973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Controller, record=71388482-d594-4fea-a23e-fe179e86eded, col_values=(('connection_mode', 'out-of-band'),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 00:56:30.577631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Controller, record=71388482-d594-4fea-a23e-fe179e86eded, col_values=(('inactivity_probe', 10000),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 00:56:30.588863 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Bridge, record=br-int, col_values=(('mcast_snooping_enable', False),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 00:56:30.590378 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(table=Bridge, record=br-int, col_values=(('other_config', {'mcast-snooping-disable-flood-unregistered': 'false'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 00:56:30.605441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_bridge [-] Bridge br-int has datapath-ID 0000da6d7ce10744 Sep 04 00:56:30.608827 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x38,xid=0xea88b25a,OFPFlowMod(buffer_id=4294967295,command=0,cookie=6887031442322345889,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={}),out_group=0,out_port=0,priority=0,table_id=23) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:56:30.611539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xea88b25c,OFPFlowMod(buffer_id=4294967295,command=0,cookie=6887031442322345889,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={}),out_group=0,out_port=0,priority=0,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:56:30.614708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xea88b25e,OFPFlowMod(buffer_id=4294967295,command=0,cookie=6887031442322345889,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionGotoTable(len=8,table_id=60,type=1)],match=OFPMatch(oxm_fields={}),out_group=0,out_port=0,priority=0,table_id=59) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:56:30.621746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x50,xid=0xea88b260,OFPFlowMod(buffer_id=4294967295,command=0,cookie=6887031442322345889,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=24,type=4)],match=OFPMatch(oxm_fields={}),out_group=0,out_port=0,priority=3,table_id=60) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:56:30.625222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x38,xid=0xea88b262,OFPFlowMod(buffer_id=4294967295,command=0,cookie=6887031442322345889,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={}),out_group=0,out_port=0,priority=0,table_id=24) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:56:30.627951 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xea88b264,OFPFlowMod(buffer_id=4294967295,command=0,cookie=6887031442322345889,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'vlan_vid': 8191}),out_group=0,out_port=0,priority=65535,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:56:30.630830 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x50,xid=0xea88b266,OFPFlowMod(buffer_id=4294967295,command=0,cookie=6887031442322345889,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=24,type=4)],match=OFPMatch(oxm_fields={}),out_group=0,out_port=0,priority=3,table_id=62) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:56:30.633244 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xea88b268,OFPFlowMod(buffer_id=4294967295,command=0,cookie=6887031442322345889,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={}),out_group=0,out_port=0,priority=0,table_id=30) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:56:30.636227 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xea88b26a,OFPFlowMod(buffer_id=4294967295,command=0,cookie=6887031442322345889,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={}),out_group=0,out_port=0,priority=0,table_id=31) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:56:30.636827 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.utils [-] Std library socket module is patched by eventlet. Requesting std library socket module from eventlet. {{(pid=107812) __init__ /opt/stack/neutron/neutron/agent/common/utils.py:91}} Sep 04 00:56:30.639071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] Mapping physical network physnet1 to bridge br-data Sep 04 00:56:30.640187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] Bridge br-data datapath-id = 0x00008ab64da16b4f Sep 04 00:56:30.641104 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(name=br-data, may_exist=True, datapath_type=system) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 00:56:30.641686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbAddCommand(table=Bridge, record=br-data, column=protocols, values=('OpenFlow14', 'OpenFlow13', 'OpenFlow10')) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 00:56:30.642328 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(table=Bridge, record=br-data, col_values=(('other_config', {'mac-table-size': '50000'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 00:56:30.650461 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): SetFailModeCommand(bridge=br-data, mode=secure) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 00:56:30.659389 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_bridge [-] Setting controller tcp:127.0.0.1:6633 for bridge br-data. {{(pid=107812) setup_controllers /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ovs_bridge.py:80}} Sep 04 00:56:30.661381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): SetControllerCommand(bridge=br-data, targets=['tcp:127.0.0.1:6633']) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 00:56:31.674088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Controller, record=5333ea03-f17f-4ddf-8def-7972106a9efb, col_values=(('connection_mode', 'out-of-band'),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 00:56:31.682441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Controller, record=5333ea03-f17f-4ddf-8def-7972106a9efb, col_values=(('inactivity_probe', 10000),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 00:56:31.689898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_bridge [-] Bridge br-data has datapath-ID 00008ab64da16b4f Sep 04 00:56:31.693987 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x50,xid=0x1fd38be1,OFPFlowMod(buffer_id=4294967295,command=0,cookie=6561907047025962751,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=24,type=4)],match=OFPMatch(oxm_fields={}),out_group=0,out_port=0,priority=0,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:56:31.695459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(bridge=br-int, port=int-br-data, may_exist=True) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 00:56:31.707950 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(table=Interface, record=int-br-data, col_values=(('type', 'patch'), ('options', {'peer': 'nonexistent-peer'}))) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 00:56:31.723610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=int-br-data, col_values=(('other_config', {'mcast-snooping-flood-reports': 'False', 'mcast-snooping-flood': 'False'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 00:56:31.740039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(bridge=br-data, port=phy-br-data, may_exist=True) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 00:56:31.740700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(table=Interface, record=phy-br-data, col_values=(('type', 'patch'), ('options', {'peer': 'nonexistent-peer'}))) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 00:56:31.764665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xea88b26c,OFPFlowMod(buffer_id=4294967295,command=0,cookie=6887031442322345889,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:56:31.768503 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x1fd38be3,OFPFlowMod(buffer_id=4294967295,command=0,cookie=6561907047025962751,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:56:31.770234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Interface, record=int-br-data, col_values=(('options', {'peer': 'phy-br-data'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 00:56:31.784007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Interface, record=phy-br-data, col_values=(('options', {'peer': 'int-br-data'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 00:56:31.798061 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.callbacks.resource_manager [-] Registering callback for Port {{(pid=107812) register /opt/stack/neutron/neutron/api/rpc/callbacks/resource_manager.py:62}} Sep 04 00:56:31.803153 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.callbacks.resource_manager [-] Registering callback for SecurityGroup {{(pid=107812) register /opt/stack/neutron/neutron/api/rpc/callbacks/resource_manager.py:62}} Sep 04 00:56:31.804891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.callbacks.resource_manager [-] Registering callback for SecurityGroupRule {{(pid=107812) register /opt/stack/neutron/neutron/api/rpc/callbacks/resource_manager.py:62}} Sep 04 00:56:31.805971 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.callbacks.resource_manager [-] Registering callback for Network {{(pid=107812) register /opt/stack/neutron/neutron/api/rpc/callbacks/resource_manager.py:62}} Sep 04 00:56:31.809233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.callbacks.resource_manager [-] Registering callback for Subnet {{(pid=107812) register /opt/stack/neutron/neutron/api/rpc/callbacks/resource_manager.py:62}} Sep 04 00:56:31.810322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.callbacks.resource_manager [-] Registering callback for AddressGroup {{(pid=107812) register /opt/stack/neutron/neutron/api/rpc/callbacks/resource_manager.py:62}} Sep 04 00:56:31.983964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > Port after_update 55550000 {{(pid=107812) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 04 00:56:31.984464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > Network after_update 55550000 {{(pid=107812) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 04 00:56:31.984878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > Port after_delete 55550000 {{(pid=107812) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 04 00:56:31.985284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > Network after_delete 55550000 {{(pid=107812) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 04 00:56:31.985688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > SecurityGroup after_delete 55550000 {{(pid=107812) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 04 00:56:31.986081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > SecurityGroup after_update 55550000 {{(pid=107812) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 04 00:56:32.073742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Init firewall settings (driver=openvswitch) {{(pid=107812) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:121}} Sep 04 00:56:32.074919 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbAddCommand(table=Bridge, record=br-int, column=protocols, values=('OpenFlow12', 'OpenFlow11')) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 00:56:33.103054 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5279,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=71,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:56:33.106083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade527b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=72,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:56:33.108532 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade527d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=73,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:56:33.112234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade527f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=81,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:56:33.114624 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5281,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=82,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:56:33.115536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.ip_conntrack [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Starting ip_conntrack _process_queue_worker() threads {{(pid=107812) _start_process_queue /opt/stack/neutron/neutron/agent/linux/ip_conntrack.py:80}} Sep 04 00:56:33.116549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Processing 1 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 00:56:33.119083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO oslo.privsep.daemon [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Running privsep helper: ['sudo', '/usr/local/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--privsep_context', 'neutron.privileged.default', '--privsep_sock_path', '/tmp/tmp12yqqalt/privsep.sock'] Sep 04 00:56:33.137957 dv-cinder-master-3-iscsi sudo[109499]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf privsep-helper --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --privsep_context neutron.privileged.default --privsep_sock_path /tmp/tmp12yqqalt/privsep.sock Sep 04 00:56:33.139619 dv-cinder-master-3-iscsi sudo[109499]: pam_unix(sudo:session): session opened for user root by (uid=0) Sep 04 00:56:34.686831 dv-cinder-master-3-iscsi sudo[109499]: pam_unix(sudo:session): session closed for user root Sep 04 00:56:34.690749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO oslo.privsep.daemon [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Spawned new privsep daemon via rootwrap Sep 04 00:56:34.692062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Accepted privsep connection to /tmp/tmp12yqqalt/privsep.sock {{(pid=107812) __init__ /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:362}} Sep 04 00:56:34.693533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 04 00:56:34.694035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 04 00:56:34.694570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_NET_ADMIN|CAP_SYS_ADMIN|CAP_SYS_PTRACE/CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_NET_ADMIN|CAP_SYS_ADMIN|CAP_SYS_PTRACE/none Sep 04 00:56:34.695040 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 109513 Sep 04 00:56:34.698901 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[c544758e-4871-488f-8cf5-35d376d1be2b]: (2,) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 00:56:35.403781 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "context-manager" by "neutron_lib.db.api._create_context_manager" {{(pid=109513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 00:56:35.405217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo_concurrency.lockutils [-] Lock "context-manager" acquired by "neutron_lib.db.api._create_context_manager" :: waited 0.002s {{(pid=109513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 00:56:35.406063 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo_concurrency.lockutils [-] Lock "context-manager" "released" by "neutron_lib.db.api._create_context_manager" :: held 0.001s {{(pid=109513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 00:56:35.673325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[78bee9ba-325f-492b-b287-a71ab734ad2a]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 00:56:35.674035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Processing 1 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 00:56:35.683586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07b1412-289b-4a32-b97b-b2fcd0351afb]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 00:56:35.684148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Processing 1 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 00:56:35.698569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dee6132-fc61-4031-b4e5-f8df52c3bf7f]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 00:56:35.699952 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Processing 1 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 00:56:35.710398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e11fd2a-c2f7-4f23-a4a3-7217725c31d6]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 00:56:35.711004 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Processing 1 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 00:56:35.721303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[8585563f-0759-49a1-8dc8-23947e141c7f]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 00:56:35.722101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Processing 1 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 00:56:35.731806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cebdbc8-bbda-446c-a45f-5ca611e4a885]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 00:56:35.732687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Processing 1 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 00:56:35.741736 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[299527df-adf6-452a-bc4b-779888a0c9ef]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 00:56:35.742871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Processing 1 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 00:56:35.754266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff741b8-5c9c-4ba7-b52e-5a5bc66a70ad]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 00:56:35.755024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Processing 1 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 00:56:35.765189 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[1efcefa2-8dda-42a6-91de-c72c17c9fcea]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 00:56:35.765874 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Processing 1 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 00:56:35.785544 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[f366a08f-eb26-42b6-bbc0-25075cf4d5ec]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 00:56:35.786384 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Subscribe: > agent ovs_restarted 55550000 {{(pid=107812) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 04 00:56:35.787192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Subscribe: > SecurityGroupRule after_delete 55550000 {{(pid=107812) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 04 00:56:35.787747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Subscribe: > SecurityGroupRule after_update 55550000 {{(pid=107812) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 04 00:56:35.788158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Subscribe: > Port after_delete 55550000 {{(pid=107812) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 04 00:56:35.788582 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Subscribe: > Port after_update 55550000 {{(pid=107812) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 04 00:56:35.788981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Subscribe: > AddressGroup after_update 55550000 {{(pid=107812) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 04 00:56:35.789381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Subscribe: > AddressGroup after_delete 55550000 {{(pid=107812) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 04 00:56:35.877683 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.driver.init_handler-8768322011320'] for Open vSwitch agent (None), after_init {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 00:56:35.878457 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Subscribe: > ovsdb after_read 55550000 {{(pid=107812) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 04 00:56:35.879409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Subscribe: > Trunk before_create 55550000 {{(pid=107812) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 04 00:56:35.881600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.callbacks.resource_manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Registering callback for Trunk {{(pid=107812) register /opt/stack/neutron/neutron/api/rpc/callbacks/resource_manager.py:62}} Sep 04 00:56:35.882802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.callbacks.resource_manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Registering callback for SubPort {{(pid=107812) register /opt/stack/neutron/neutron/api/rpc/callbacks/resource_manager.py:62}} Sep 04 00:56:35.939458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.callbacks.resource_manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Unregistering callback for Trunk {{(pid=107812) unregister /opt/stack/neutron/neutron/api/rpc/callbacks/resource_manager.py:72}} Sep 04 00:56:35.940149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent initialized successfully, now running... Sep 04 00:56:35.941455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO oslo.privsep.daemon [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Running privsep helper: ['sudo', '/usr/local/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--privsep_context', 'neutron.privileged.ovs_vsctl_cmd', '--privsep_sock_path', '/tmp/tmp59d4uvay/privsep.sock'] Sep 04 00:56:35.954995 dv-cinder-master-3-iscsi sudo[109566]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf privsep-helper --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --privsep_context neutron.privileged.ovs_vsctl_cmd --privsep_sock_path /tmp/tmp59d4uvay/privsep.sock Sep 04 00:56:35.955932 dv-cinder-master-3-iscsi sudo[109566]: pam_unix(sudo:session): session opened for user root by (uid=0) Sep 04 00:56:37.234381 dv-cinder-master-3-iscsi sudo[109566]: pam_unix(sudo:session): session closed for user root Sep 04 00:56:37.242190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO oslo.privsep.daemon [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Spawned new privsep daemon via rootwrap Sep 04 00:56:37.242969 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Accepted privsep connection to /tmp/tmp59d4uvay/privsep.sock {{(pid=107812) __init__ /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:362}} Sep 04 00:56:37.244682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 04 00:56:37.244934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 04 00:56:37.245213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 04 00:56:37.245462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 109570 Sep 04 00:56:37.248294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e609b3-0bfe-4514-b1fd-da4b7eacb821]: (2,) {{(pid=109570) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 00:56:37.469157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): ovs-vsctl --timeout=10 --id=@manager -- create Manager target="ptcp:6640:127.0.0.1" -- add Open_vSwitch . manager_options @manager -- set Manager ptcp:6640:127.0.0.1 inactivity_probe=10000 {{(pid=109570) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Sep 04 00:56:37.474973 dv-cinder-master-3-iscsi ovs-vsctl[109574]: ovs|00001|vsctl|INFO|Called as ovs-vsctl --timeout=10 --id=@manager -- create Manager "target=\"ptcp:6640:127.0.0.1\"" -- add Open_vSwitch . manager_options @manager -- set Manager ptcp:6640:127.0.0.1 inactivity_probe=10000 Sep 04 00:56:37.538651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo_concurrency.processutils [-] CMD "ovs-vsctl --timeout=10 --id=@manager -- create Manager target="ptcp:6640:127.0.0.1" -- add Open_vSwitch . manager_options @manager -- set Manager ptcp:6640:127.0.0.1 inactivity_probe=10000" returned: 1 in 0.011s {{(pid=109570) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Sep 04 00:56:37.538651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dddf02f-682d-4f96-b946-c60b63800b0a]: (4, ('', 'ovs-vsctl: multiple rows in Manager match "ptcp:6640:127.0.0.1"\n')) {{(pid=109570) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 00:56:37.538651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Launching async process [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]. {{(pid=107812) start /opt/stack/neutron/neutron/agent/common/async_process.py:117}} Sep 04 00:56:37.538651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Running command: ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] {{(pid=107812) create_process /opt/stack/neutron/neutron/agent/linux/utils.py:84}} Sep 04 00:56:37.538651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:56:37.477571 dv-cinder-master-3-iscsi ovs-vsctl[109574]: ovs|00002|db_ctl_base|ERR|multiple rows in Manager match "ptcp:6640:127.0.0.1" Sep 04 00:56:37.539351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:0 started Sep 04 00:56:37.539351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["ef94e20e-9472-452d-a43f-c5fbec6ebe96","initial","eth1",1,["map",[]]],["d0f9c156-fe7f-4054-8421-2cd379e7c740","initial","br-int",65534,["map",[]]],["bcc851a3-585d-47a5-ab5b-e8c457c3073c","initial","phy-br-data",2,["map",[]]],["c536c18f-3ac1-4177-ad2c-123ff3a0f1f6","initial","br-data",65534,["map",[]]],["e0409e7f-7d61-40d0-b2e5-1e5b371b292e","initial","int-br-data",1,["map",[]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 00:56:37.539351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5283,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=885000000,duration_sec=6,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:56:37.539622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:56:37.539622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:0 - starting polling. Elapsed:0.008 Sep 04 00:56:37.539622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 00:56:37.539622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:0 - port information retrieved. Elapsed:0.010 Sep 04 00:56:37.539622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Cleaning stale br-int flows Sep 04 00:56:37.539622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Reserved cookies for br-int: {6887031442322345889} Sep 04 00:56:37.540087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5285,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=0,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=875000000,duration_sec=6,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=64,match=OFPMatch(oxm_fields={'vlan_vid': 8191}),packet_count=0,priority=65535,table_id=0), OFPFlowStats(byte_count=11300,cookie=6887031442322345889,duration_nsec=740000000,duration_sec=5,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=64,match=OFPMatch(oxm_fields={'in_port': 1}),packet_count=64,priority=2,table_id=0), OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=891000000,duration_sec=6,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionGotoTable(len=8,table_id=59,type=1)],length=64,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=0)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:56:37.540087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5287,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=1,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:56:37.540390 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5289,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=2,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:56:37.540390 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade528b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=901000000,duration_sec=6,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:56:37.540632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade528d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=24,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=886000000,duration_sec=6,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=24)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:56:37.540632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade528f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=25,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:56:37.540632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5291,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=61,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:56:37.540909 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5293,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=30,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=884000000,duration_sec=6,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionGotoTable(len=8,table_id=59,type=1)],length=64,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=30)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:56:37.540909 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5295,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=31,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=883000000,duration_sec=6,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionGotoTable(len=8,table_id=59,type=1)],length=64,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=31)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:56:37.541112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5297,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=59,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=907000000,duration_sec=6,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionGotoTable(len=8,table_id=60,type=1)],length=64,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=59)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:56:37.541112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5299,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=60,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=903000000,duration_sec=6,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=24,type=4)],length=80,match=OFPMatch(oxm_fields={}),packet_count=0,priority=3,table_id=60)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:56:37.541288 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade529b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=62,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=896000000,duration_sec=6,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=24,type=4)],length=80,match=OFPMatch(oxm_fields={}),packet_count=0,priority=3,table_id=62)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:56:37.541395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade529d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=71,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=798000000,duration_sec=1,flags=4,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[NXActionCTClear(experimenter=8992,len=16,subtype=43,type=65535), NXActionResubmitTable(experimenter=8992,in_port=65528,len=16,subtype=14,table_id=71,type=65535)],len=40,type=4)],length=104,match=OFPMatch(oxm_fields={'ct_state': (32, 32)}),packet_count=0,priority=110,table_id=71), OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=857000000,duration_sec=1,flags=4,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=71)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:56:37.541506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade529f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=72,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=849000000,duration_sec=1,flags=4,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=72)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:56:37.541506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade52a1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=73,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=840000000,duration_sec=1,flags=4,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=73)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:56:37.541741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade52a3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=77,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:56:37.541741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade52a5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=78,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:56:37.541741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade52a7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=81,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=830000000,duration_sec=1,flags=4,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=81)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:56:37.541999 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade52a9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=82,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=821000000,duration_sec=1,flags=4,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=82)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:56:37.543922 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade52ab,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=91,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=790000000,duration_sec=1,flags=4,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[NXActionResubmitTable(experimenter=8992,in_port=65528,len=16,subtype=14,table_id=94,type=65535)],len=24,type=4)],length=80,match=OFPMatch(oxm_fields={}),packet_count=0,priority=1,table_id=91)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:56:37.545977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade52ad,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=92,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=782000000,duration_sec=1,flags=4,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=92)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:56:37.548011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade52af,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=93,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=773000000,duration_sec=1,flags=4,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=93)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:56:37.548315 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Cleaning stale br-data flows Sep 04 00:56:37.548606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Reserved cookies for br-data: {6561907047025962751} Sep 04 00:56:37.551143 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x1fd38be5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=0,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6561907047025962751,duration_nsec=782000000,duration_sec=5,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=64,match=OFPMatch(oxm_fields={'in_port': 2}),packet_count=0,priority=2,table_id=0), OFPFlowStats(byte_count=11300,cookie=6561907047025962751,duration_nsec=857000000,duration_sec=5,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=24,type=4)],length=80,match=OFPMatch(oxm_fields={}),packet_count=64,priority=0,table_id=0)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:56:37.552957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x1fd38be7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=1,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:56:37.554770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x1fd38be9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=2,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:56:37.557100 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x1fd38beb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=3,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:56:37.557420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:0 - cleanup stale flows. Elapsed:0.068 Sep 04 00:56:37.557768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:0 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.068 Sep 04 00:56:39.491313 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:1 started Sep 04 00:56:39.494146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade52b1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=885000000,duration_sec=8,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:56:39.494717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:56:39.495062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:1 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 00:56:41.492974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:2 started Sep 04 00:56:41.495753 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade52b3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=887000000,duration_sec=10,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:56:41.496312 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:56:41.496660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:2 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 00:56:41.720868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: WARNING oslo_policy.policy [None req-43f71770-d6bb-4ea5-9eeb-b85eeb0ec571 demo demo] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Sep 04 00:56:41.721398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: WARNING oslo_policy.policy [None req-43f71770-d6bb-4ea5-9eeb-b85eeb0ec571 demo demo] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Sep 04 00:56:41.725375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-43f71770-d6bb-4ea5-9eeb-b85eeb0ec571 demo demo] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T00:56:41Z,description='Default security group',id=1cf97885-b9ee-4ef3-a136-1d13f9106e7b,is_default=True,name='default',project_id='1193eb16a76d432faf6141e47cc99c5a',revision_number=1,rules=[SecurityGroupRule(1c031e89-81da-48e2-b47b-4b02f5c0eb5d),SecurityGroupRule(2c739ca3-8148-4af5-9324-0086c96c1f72),SecurityGroupRule(41ede3b0-684e-47d3-9249-0d43f417fb47),SecurityGroupRule(675abb94-2989-47ad-9942-a224383d1296)],shared=False,stateful=True,updated_at=2022-09-04T00:56:41Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 00:56:41.725782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-43f71770-d6bb-4ea5-9eeb-b85eeb0ec571 demo demo] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (1cf97885-b9ee-4ef3-a136-1d13f9106e7b), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 00:56:41.726414 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-43f71770-d6bb-4ea5-9eeb-b85eeb0ec571 demo demo] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T00:56:41Z,description=,direction='egress',ethertype='IPv4',id=1c031e89-81da-48e2-b47b-4b02f5c0eb5d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1193eb16a76d432faf6141e47cc99c5a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=1cf97885-b9ee-4ef3-a136-1d13f9106e7b,updated_at=2022-09-04T00:56:41Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 00:56:41.726779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-43f71770-d6bb-4ea5-9eeb-b85eeb0ec571 demo demo] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (1c031e89-81da-48e2-b47b-4b02f5c0eb5d), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 00:56:41.727150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-43f71770-d6bb-4ea5-9eeb-b85eeb0ec571 demo demo] Security group rule updated ['1cf97885-b9ee-4ef3-a136-1d13f9106e7b'] Sep 04 00:56:41.728268 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-43f71770-d6bb-4ea5-9eeb-b85eeb0ec571 demo demo] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T00:56:41Z,description=,direction='ingress',ethertype='IPv6',id=2c739ca3-8148-4af5-9324-0086c96c1f72,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1193eb16a76d432faf6141e47cc99c5a',protocol=,remote_address_group_id=,remote_group_id=1cf97885-b9ee-4ef3-a136-1d13f9106e7b,remote_ip_prefix=,revision_number=0,security_group_id=1cf97885-b9ee-4ef3-a136-1d13f9106e7b,updated_at=2022-09-04T00:56:41Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 00:56:41.728634 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-43f71770-d6bb-4ea5-9eeb-b85eeb0ec571 demo demo] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (2c739ca3-8148-4af5-9324-0086c96c1f72), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 00:56:41.728970 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-43f71770-d6bb-4ea5-9eeb-b85eeb0ec571 demo demo] Security group rule updated ['1cf97885-b9ee-4ef3-a136-1d13f9106e7b'] Sep 04 00:56:41.729732 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-43f71770-d6bb-4ea5-9eeb-b85eeb0ec571 demo demo] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T00:56:41Z,description=,direction='ingress',ethertype='IPv4',id=41ede3b0-684e-47d3-9249-0d43f417fb47,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1193eb16a76d432faf6141e47cc99c5a',protocol=,remote_address_group_id=,remote_group_id=1cf97885-b9ee-4ef3-a136-1d13f9106e7b,remote_ip_prefix=,revision_number=0,security_group_id=1cf97885-b9ee-4ef3-a136-1d13f9106e7b,updated_at=2022-09-04T00:56:41Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 00:56:41.730095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-43f71770-d6bb-4ea5-9eeb-b85eeb0ec571 demo demo] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (41ede3b0-684e-47d3-9249-0d43f417fb47), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 00:56:41.730426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-43f71770-d6bb-4ea5-9eeb-b85eeb0ec571 demo demo] Security group rule updated ['1cf97885-b9ee-4ef3-a136-1d13f9106e7b'] Sep 04 00:56:41.731135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-43f71770-d6bb-4ea5-9eeb-b85eeb0ec571 demo demo] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T00:56:41Z,description=,direction='egress',ethertype='IPv6',id=675abb94-2989-47ad-9942-a224383d1296,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1193eb16a76d432faf6141e47cc99c5a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=1cf97885-b9ee-4ef3-a136-1d13f9106e7b,updated_at=2022-09-04T00:56:41Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 00:56:41.731493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-43f71770-d6bb-4ea5-9eeb-b85eeb0ec571 demo demo] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (675abb94-2989-47ad-9942-a224383d1296), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 00:56:41.731824 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-43f71770-d6bb-4ea5-9eeb-b85eeb0ec571 demo demo] Security group rule updated ['1cf97885-b9ee-4ef3-a136-1d13f9106e7b'] Sep 04 00:56:41.966715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-43f71770-d6bb-4ea5-9eeb-b85eeb0ec571 demo demo] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-04T00:56:41Z,description='',dns_domain=None,id=0405aef7-a260-406a-9f15-0b66416e7839,mtu=1500,name='private',project_id='1193eb16a76d432faf6141e47cc99c5a',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(0405aef7-a260-406a-9f15-0b66416e7839),segments=[NetworkSegment(c21c3d7a-66ca-44c3-9aa5-fc700bb242f0)],shared=False,status='ACTIVE',updated_at=2022-09-04T00:56:41Z,vlan_transparent=) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 00:56:41.967109 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-43f71770-d6bb-4ea5-9eeb-b85eeb0ec571 demo demo] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533'] for Network (0405aef7-a260-406a-9f15-0b66416e7839), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 00:56:42.097058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager [None req-43f71770-d6bb-4ea5-9eeb-b85eeb0ec571 demo demo] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 0405aef7-a260-406a-9f15-0b66416e7839 with segmentation id not found. Sep 04 00:56:42.097058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 04 00:56:42.097058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 04 00:56:42.097058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 04 00:56:42.097058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 04 00:56:42.097058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 04 00:56:42.097058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 04 00:56:42.097058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 04 00:56:42.097058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 04 00:56:42.097058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 04 00:56:42.097058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 04 00:56:42.097058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 04 00:56:42.097058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 04 00:56:42.098200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 04 00:56:42.098200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 04 00:56:42.098200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 04 00:56:42.098200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 0405aef7-a260-406a-9f15-0b66416e7839 with segmentation id not found. Sep 04 00:56:42.098200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager Sep 04 00:56:43.493759 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:3 started Sep 04 00:56:43.496404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade52b5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=888000000,duration_sec=12,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:56:43.496948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:56:43.497331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:3 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 00:56:45.494566 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:4 started Sep 04 00:56:45.497007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade52b7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=889000000,duration_sec=14,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:56:45.497588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:56:45.497937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:4 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 00:56:45.588697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-87b19073-e9f2-475c-841e-0e74e527c6b0 demo admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(82a9ed2f-f0e3-4bb5-b83a-2c0805dc242f)],cidr=172.20.0.0/26,created_at=2022-09-04T00:56:45Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=c9461236-5726-4fb5-be73-5965e5067b2c,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='private-subnet',network_id=0405aef7-a260-406a-9f15-0b66416e7839,project_id='1193eb16a76d432faf6141e47cc99c5a',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id='5cfa5bcb-05d6-4eb4-b3b8-1e9af3f14616',updated_at=2022-09-04T00:56:45Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 00:56:45.589087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-87b19073-e9f2-475c-841e-0e74e527c6b0 demo admin] Publish callbacks [] for Subnet (c9461236-5726-4fb5-be73-5965e5067b2c), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 00:56:46.767160 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-2d892f1d-e646-4aaf-bde4-91073c1a7d1f None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T00:56:46Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-0405aef7-a260-406a-9f15-0b66416e7839',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=89aa06b4-bbf1-40c2-bb48-500c3aecdf48,mac_address=fa:16:3e:08:d4:16,name='',network_id=0405aef7-a260-406a-9f15-0b66416e7839,numa_affinity_policy=,project_id='1193eb16a76d432faf6141e47cc99c5a',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(89aa06b4-bbf1-40c2-bb48-500c3aecdf48),security_group_ids=set([]),status='DOWN',updated_at=2022-09-04T00:56:46Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 00:56:46.768200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-2d892f1d-e646-4aaf-bde4-91073c1a7d1f None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (89aa06b4-bbf1-40c2-bb48-500c3aecdf48), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 00:56:47.059115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-2d892f1d-e646-4aaf-bde4-91073c1a7d1f None None] Resource Port 89aa06b4-bbf1-40c2-bb48-500c3aecdf48 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=89aa06b4-bbf1-40c2-bb48-500c3aecdf48,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=89aa06b4-bbf1-40c2-bb48-500c3aecdf48,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=89aa06b4-bbf1-40c2-bb48-500c3aecdf48,segment=NetworkSegment(c21c3d7a-66ca-44c3-9aa5-fc700bb242f0),segment_id=c21c3d7a-66ca-44c3-9aa5-fc700bb242f0)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 00:56:47.059504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-2d892f1d-e646-4aaf-bde4-91073c1a7d1f None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (89aa06b4-bbf1-40c2-bb48-500c3aecdf48), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 00:56:47.496031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:5 started Sep 04 00:56:47.498593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade52b9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=890000000,duration_sec=16,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:56:47.499217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:56:47.499610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:5 - starting polling. Elapsed:0.004 Sep 04 00:56:47.500977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 00:56:47.501918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:5 - port information retrieved. Elapsed:0.006 Sep 04 00:56:47.502303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:5 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 04 00:56:49.497673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:6 started Sep 04 00:56:49.500388 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade52bb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=892000000,duration_sec=18,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:56:49.501066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:56:49.501524 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:6 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 00:56:51.498912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:7 started Sep 04 00:56:51.502081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade52bd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=893000000,duration_sec=20,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:56:51.502729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:56:51.503148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:7 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 00:56:53.500486 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:8 started Sep 04 00:56:53.503455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade52bf,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=895000000,duration_sec=22,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:56:53.504045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:56:53.504397 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:8 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 00:56:53.869130 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["b3b87564-4f47-4f8d-8fa1-d2961642ce53","insert","tap89aa06b4-bb",["set",[]],["map",[["attached-mac","fa:16:3e:08:d4:16"],["iface-id","89aa06b4-bbf1-40c2-bb48-500c3aecdf48"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 00:56:53.880385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["b3b87564-4f47-4f8d-8fa1-d2961642ce53","old",null,["set",[]],null],["","new","tap89aa06b4-bb",2,["map",[["attached-mac","fa:16:3e:08:d4:16"],["iface-id","89aa06b4-bbf1-40c2-bb48-500c3aecdf48"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 00:56:55.501118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:9 started Sep 04 00:56:55.504195 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade52c1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=896000000,duration_sec=24,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:56:55.504937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:56:55.505627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:9 - starting polling. Elapsed:0.005 Sep 04 00:56:55.506631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 00:56:55.507750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:9 - port information retrieved. Elapsed:0.007 Sep 04 00:56:55.508283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Starting to process devices in:{'current': {'89aa06b4-bbf1-40c2-bb48-500c3aecdf48'}, 'added': {'89aa06b4-bbf1-40c2-bb48-500c3aecdf48'}, 'removed': set(), 'updated': set(), 're_added': set()} {{(pid=107812) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 04 00:56:55.509151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': '89aa06b4-bbf1-40c2-bb48-500c3aecdf48', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-0405aef7-a260-406a-9f15-0b66416e7839', 'network_id': '0405aef7-a260-406a-9f15-0b66416e7839', 'port_id': '89aa06b4-bbf1-40c2-bb48-500c3aecdf48', 'mac_address': 'fa:16:3e:08:d4:16', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 195, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'c9461236-5726-4fb5-be73-5965e5067b2c', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 00:56:55.510365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: 89aa06b4-bbf1-40c2-bb48-500c3aecdf48 {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 00:56:55.510779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 89aa06b4-bbf1-40c2-bb48-500c3aecdf48 updated. Details: {'device': '89aa06b4-bbf1-40c2-bb48-500c3aecdf48', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-0405aef7-a260-406a-9f15-0b66416e7839', 'network_id': '0405aef7-a260-406a-9f15-0b66416e7839', 'port_id': '89aa06b4-bbf1-40c2-bb48-500c3aecdf48', 'mac_address': 'fa:16:3e:08:d4:16', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 195, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'c9461236-5726-4fb5-be73-5965e5067b2c', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Sep 04 00:56:55.511197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Assigning 1 as local vlan for net-id=0405aef7-a260-406a-9f15-0b66416e7839, seg-id=195 Sep 04 00:56:55.514761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0x1fd38bed,OFPFlowMod(buffer_id=4294967295,command=0,cookie=6561907047025962751,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4291), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4097}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:56:55.521483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0xeade52c3,OFPFlowMod(buffer_id=4294967295,command=0,cookie=6887031442322345889,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4097)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4291}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:56:55.521483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap89aa06b4-bb, col_values=(('tag', 1),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 00:56:55.521483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap89aa06b4-bb, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 00:56:55.521483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap89aa06b4-bb, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 00:56:55.526533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap89aa06b4-bb, col_values=(('other_config', {'net_uuid': '0405aef7-a260-406a-9f15-0b66416e7839', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '1', 'segmentation_id': '195'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 00:56:55.536761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade52c5,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:56:55.537168 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:9 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 1 devices currently available. Time elapsed: 0.028 Sep 04 00:56:55.537798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Preparing device filters for 1 new devices {{(pid=107812) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 04 00:56:55.538526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Preparing filters for devices {'89aa06b4-bbf1-40c2-bb48-500c3aecdf48'} Sep 04 00:56:55.540618 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information for ports dict_keys([]) {{(pid=107812) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 04 00:56:55.541057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information {{(pid=107812) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 04 00:56:55.543036 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 2 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 00:56:55.586966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b8106b-d69c-4971-a8eb-8c45b7f53673]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 00:56:55.587651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:9 - agent port security group processed in 0.079 Sep 04 00:56:55.588217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for 89aa06b4-bbf1-40c2-bb48-500c3aecdf48 to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 00:56:55.649878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-344459d8-6700-4795-8340-c489ac96c60f None None] Resource Port 89aa06b4-bbf1-40c2-bb48-500c3aecdf48 updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 00:56:55.650289 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-344459d8-6700-4795-8340-c489ac96c60f None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (89aa06b4-bbf1-40c2-bb48-500c3aecdf48), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 00:56:55.781227 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Configuration for devices up ['89aa06b4-bbf1-40c2-bb48-500c3aecdf48'] and devices down [] completed. Sep 04 00:56:55.781647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:9 - ports processed. Elapsed:0.281 Sep 04 00:56:55.782079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:9 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 0, 'removed': 0}}. Elapsed:0.281 Sep 04 00:56:57.502281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:10 started Sep 04 00:56:57.505013 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade52c7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=896000000,duration_sec=26,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:56:57.505719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:56:57.506061 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:10 - starting polling. Elapsed:0.004 Sep 04 00:56:57.507029 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 00:56:57.508989 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:10 - port information retrieved. Elapsed:0.007 Sep 04 00:56:57.509340 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Starting to process devices in:{'current': {'89aa06b4-bbf1-40c2-bb48-500c3aecdf48'}, 'added': set(), 'removed': set(), 'updated': {'89aa06b4-bbf1-40c2-bb48-500c3aecdf48'}, 're_added': set()} {{(pid=107812) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 04 00:56:57.509908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': '89aa06b4-bbf1-40c2-bb48-500c3aecdf48', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-0405aef7-a260-406a-9f15-0b66416e7839', 'network_id': '0405aef7-a260-406a-9f15-0b66416e7839', 'port_id': '89aa06b4-bbf1-40c2-bb48-500c3aecdf48', 'mac_address': 'fa:16:3e:08:d4:16', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 195, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'c9461236-5726-4fb5-be73-5965e5067b2c', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 00:56:57.510707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: 89aa06b4-bbf1-40c2-bb48-500c3aecdf48 {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 00:56:57.511052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 89aa06b4-bbf1-40c2-bb48-500c3aecdf48 updated. Details: {'device': '89aa06b4-bbf1-40c2-bb48-500c3aecdf48', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-0405aef7-a260-406a-9f15-0b66416e7839', 'network_id': '0405aef7-a260-406a-9f15-0b66416e7839', 'port_id': '89aa06b4-bbf1-40c2-bb48-500c3aecdf48', 'mac_address': 'fa:16:3e:08:d4:16', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 195, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'c9461236-5726-4fb5-be73-5965e5067b2c', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 1} Sep 04 00:56:57.512047 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap89aa06b4-bb, col_values=(('tag', 1),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 00:56:57.512463 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap89aa06b4-bb, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 00:56:57.512854 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap89aa06b4-bb, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 00:56:57.513345 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 00:56:57.514149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap89aa06b4-bb, col_values=(('other_config', {'net_uuid': '0405aef7-a260-406a-9f15-0b66416e7839', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '195', 'tag': '1'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 00:56:57.515136 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 00:56:57.517472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade52c9,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:56:57.517808 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:10 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 1 devices currently available. Time elapsed: 0.008 Sep 04 00:56:57.518158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Refreshing firewall for 1 devices {{(pid=107812) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 04 00:56:57.518443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Refresh firewall rules Sep 04 00:56:57.519567 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information for ports dict_keys([]) {{(pid=107812) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 04 00:56:57.519845 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information {{(pid=107812) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 04 00:56:57.521486 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 2 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 00:56:57.567662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c87b83c-d130-440a-9dc9-062d9314edd8]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 00:56:57.568263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:10 - agent port security group processed in 0.059 Sep 04 00:56:57.568823 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for 89aa06b4-bbf1-40c2-bb48-500c3aecdf48 to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 00:56:57.692496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Configuration for devices up ['89aa06b4-bbf1-40c2-bb48-500c3aecdf48'] and devices down [] completed. Sep 04 00:56:57.692819 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:10 - ports processed. Elapsed:0.191 Sep 04 00:56:57.693184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:10 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.191 Sep 04 00:56:59.503474 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:11 started Sep 04 00:56:59.505924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade52cb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=897000000,duration_sec=28,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:56:59.506541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:56:59.506956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:11 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 00:57:00.266797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-d5cfbfe3-15ae-41e1-93e0-acff953637f0 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T00:57:00Z,description='Default security group',id=8f413b5a-6338-4c0b-8285-efb51c115667,is_default=True,name='default',project_id='f25649add4b1426590abafbe586fc1fa',revision_number=1,rules=[SecurityGroupRule(0af2de72-3146-464e-b6e3-6601244f344a),SecurityGroupRule(a79a3b07-07cd-4e1e-8ee7-6c6b71a53dce),SecurityGroupRule(ba70f65e-51fa-4254-82a1-a477e802140c),SecurityGroupRule(c6358497-c06c-4f7d-ad67-4936c5ccecdb)],shared=False,stateful=True,updated_at=2022-09-04T00:57:00Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 00:57:00.267178 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-d5cfbfe3-15ae-41e1-93e0-acff953637f0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (8f413b5a-6338-4c0b-8285-efb51c115667), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 00:57:00.267802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-d5cfbfe3-15ae-41e1-93e0-acff953637f0 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T00:57:00Z,description=,direction='egress',ethertype='IPv4',id=0af2de72-3146-464e-b6e3-6601244f344a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f25649add4b1426590abafbe586fc1fa',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=8f413b5a-6338-4c0b-8285-efb51c115667,updated_at=2022-09-04T00:57:00Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 00:57:00.268170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-d5cfbfe3-15ae-41e1-93e0-acff953637f0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (0af2de72-3146-464e-b6e3-6601244f344a), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 00:57:00.268538 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-d5cfbfe3-15ae-41e1-93e0-acff953637f0 admin admin] Security group rule updated ['8f413b5a-6338-4c0b-8285-efb51c115667'] Sep 04 00:57:00.269290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-d5cfbfe3-15ae-41e1-93e0-acff953637f0 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T00:57:00Z,description=,direction='ingress',ethertype='IPv4',id=a79a3b07-07cd-4e1e-8ee7-6c6b71a53dce,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f25649add4b1426590abafbe586fc1fa',protocol=,remote_address_group_id=,remote_group_id=8f413b5a-6338-4c0b-8285-efb51c115667,remote_ip_prefix=,revision_number=0,security_group_id=8f413b5a-6338-4c0b-8285-efb51c115667,updated_at=2022-09-04T00:57:00Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 00:57:00.269650 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-d5cfbfe3-15ae-41e1-93e0-acff953637f0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (a79a3b07-07cd-4e1e-8ee7-6c6b71a53dce), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 00:57:00.269981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-d5cfbfe3-15ae-41e1-93e0-acff953637f0 admin admin] Security group rule updated ['8f413b5a-6338-4c0b-8285-efb51c115667'] Sep 04 00:57:00.270692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-d5cfbfe3-15ae-41e1-93e0-acff953637f0 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T00:57:00Z,description=,direction='ingress',ethertype='IPv6',id=ba70f65e-51fa-4254-82a1-a477e802140c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f25649add4b1426590abafbe586fc1fa',protocol=,remote_address_group_id=,remote_group_id=8f413b5a-6338-4c0b-8285-efb51c115667,remote_ip_prefix=,revision_number=0,security_group_id=8f413b5a-6338-4c0b-8285-efb51c115667,updated_at=2022-09-04T00:57:00Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 00:57:00.271048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-d5cfbfe3-15ae-41e1-93e0-acff953637f0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (ba70f65e-51fa-4254-82a1-a477e802140c), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 00:57:00.271378 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-d5cfbfe3-15ae-41e1-93e0-acff953637f0 admin admin] Security group rule updated ['8f413b5a-6338-4c0b-8285-efb51c115667'] Sep 04 00:57:00.272144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-d5cfbfe3-15ae-41e1-93e0-acff953637f0 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T00:57:00Z,description=,direction='egress',ethertype='IPv6',id=c6358497-c06c-4f7d-ad67-4936c5ccecdb,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f25649add4b1426590abafbe586fc1fa',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=8f413b5a-6338-4c0b-8285-efb51c115667,updated_at=2022-09-04T00:57:00Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 00:57:00.272426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-d5cfbfe3-15ae-41e1-93e0-acff953637f0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (c6358497-c06c-4f7d-ad67-4936c5ccecdb), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 00:57:00.272754 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-d5cfbfe3-15ae-41e1-93e0-acff953637f0 admin admin] Security group rule updated ['8f413b5a-6338-4c0b-8285-efb51c115667'] Sep 04 00:57:00.499319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-d5cfbfe3-15ae-41e1-93e0-acff953637f0 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-04T00:57:00Z,description='',dns_domain=None,id=e8e0564a-d5c9-4fe0-b2d4-538f45096708,mtu=1500,name='public',project_id='f25649add4b1426590abafbe586fc1fa',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(e8e0564a-d5c9-4fe0-b2d4-538f45096708),segments=[NetworkSegment(c26850af-ca47-4ea8-9a33-a34f3381800e)],shared=False,status='ACTIVE',updated_at=2022-09-04T00:57:00Z,vlan_transparent=) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 00:57:00.499706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-d5cfbfe3-15ae-41e1-93e0-acff953637f0 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533'] for Network (e8e0564a-d5c9-4fe0-b2d4-538f45096708), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 00:57:01.504215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:12 started Sep 04 00:57:01.506622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade52cd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=898000000,duration_sec=30,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:57:01.507167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:57:01.507528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:12 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 00:57:03.505699 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:13 started Sep 04 00:57:03.508583 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade52cf,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=900000000,duration_sec=32,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:57:03.509160 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:57:03.509530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:13 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 00:57:04.571496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-5007d3d7-f8f1-44ea-92a4-9dfbc167a8c1 demo admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T00:57:03Z,data_plane_status=None,description='',device_id='09132f2f-5f0d-4cf8-9e1a-20bdebe20ba1',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=3fa24970-97a7-4f46-ac55-0b24323fa402,mac_address=fa:16:3e:2d:46:ab,name='',network_id=0405aef7-a260-406a-9f15-0b66416e7839,numa_affinity_policy=,project_id='1193eb16a76d432faf6141e47cc99c5a',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(3fa24970-97a7-4f46-ac55-0b24323fa402),security_group_ids=set([]),status='DOWN',updated_at=2022-09-04T00:57:04Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 00:57:04.580298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-5007d3d7-f8f1-44ea-92a4-9dfbc167a8c1 demo admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (3fa24970-97a7-4f46-ac55-0b24323fa402), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 00:57:05.139128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-5007d3d7-f8f1-44ea-92a4-9dfbc167a8c1 demo admin] Received resource Port update without any changes: 3fa24970-97a7-4f46-ac55-0b24323fa402 {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:181}} Sep 04 00:57:05.506717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:14 started Sep 04 00:57:05.513003 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade52d1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=901000000,duration_sec=34,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:57:05.513003 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:57:05.513003 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:14 - starting polling. Elapsed:0.004 Sep 04 00:57:05.513003 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 00:57:05.513529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:14 - port information retrieved. Elapsed:0.006 Sep 04 00:57:05.513529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:14 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 04 00:57:06.980077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-6b8c9024-029f-42d5-966a-f9d4e5724d36 None None] Resource Port 3fa24970-97a7-4f46-ac55-0b24323fa402 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=3fa24970-97a7-4f46-ac55-0b24323fa402,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=3fa24970-97a7-4f46-ac55-0b24323fa402,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 00:57:06.980740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-6b8c9024-029f-42d5-966a-f9d4e5724d36 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (3fa24970-97a7-4f46-ac55-0b24323fa402), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 00:57:07.265084 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-6b8c9024-029f-42d5-966a-f9d4e5724d36 None None] Resource Port 3fa24970-97a7-4f46-ac55-0b24323fa402 updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=3fa24970-97a7-4f46-ac55-0b24323fa402,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=3fa24970-97a7-4f46-ac55-0b24323fa402,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=3fa24970-97a7-4f46-ac55-0b24323fa402,segment=NetworkSegment(c21c3d7a-66ca-44c3-9aa5-fc700bb242f0),segment_id=c21c3d7a-66ca-44c3-9aa5-fc700bb242f0)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 00:57:07.265574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-6b8c9024-029f-42d5-966a-f9d4e5724d36 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (3fa24970-97a7-4f46-ac55-0b24323fa402), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 00:57:07.508100 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:15 started Sep 04 00:57:07.510644 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade52d3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=902000000,duration_sec=36,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:57:07.511248 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:57:07.511586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:15 - starting polling. Elapsed:0.004 Sep 04 00:57:07.512584 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 00:57:07.513480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:15 - port information retrieved. Elapsed:0.006 Sep 04 00:57:07.513811 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:15 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 04 00:57:09.509191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:16 started Sep 04 00:57:09.511596 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade52d5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=903000000,duration_sec=38,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:57:09.512143 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:57:09.512494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:16 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 00:57:09.636996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-a93250a1-dc48-4e1e-aa82-073baa58a4e4 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(5c7bfa03-1ef7-4d06-b570-1a18228b023a)],cidr=172.37.7.0/24,created_at=2022-09-04T00:57:09Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=False,gateway_ip=172.37.7.1,host_routes=[],id=2b17f894-c374-4207-90ad-14f794c86627,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='public-subnet',network_id=e8e0564a-d5c9-4fe0-b2d4-538f45096708,project_id='f25649add4b1426590abafbe586fc1fa',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-04T00:57:09Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 00:57:09.637776 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-a93250a1-dc48-4e1e-aa82-073baa58a4e4 admin admin] Publish callbacks [] for Subnet (2b17f894-c374-4207-90ad-14f794c86627), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 00:57:11.510377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:17 started Sep 04 00:57:11.513217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade52d7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=905000000,duration_sec=40,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:57:11.513780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:57:11.514134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:17 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 00:57:12.261721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["1e3f9608-45a1-4105-9426-995258d22dd0","insert","qr-3fa24970-97",["set",[]],["map",[["attached-mac","fa:16:3e:2d:46:ab"],["iface-id","3fa24970-97a7-4f46-ac55-0b24323fa402"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 00:57:12.279819 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["1e3f9608-45a1-4105-9426-995258d22dd0","old",null,["set",[]],null],["","new","qr-3fa24970-97",3,["map",[["attached-mac","fa:16:3e:2d:46:ab"],["iface-id","3fa24970-97a7-4f46-ac55-0b24323fa402"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 00:57:13.511462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:18 started Sep 04 00:57:13.514450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade52d9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=906000000,duration_sec=42,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:57:13.515019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:57:13.515505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:18 - starting polling. Elapsed:0.004 Sep 04 00:57:13.516569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 00:57:13.517782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:18 - port information retrieved. Elapsed:0.007 Sep 04 00:57:13.518099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Starting to process devices in:{'current': {'3fa24970-97a7-4f46-ac55-0b24323fa402', '89aa06b4-bbf1-40c2-bb48-500c3aecdf48'}, 'added': {'3fa24970-97a7-4f46-ac55-0b24323fa402'}, 'removed': set(), 'updated': set(), 're_added': set()} {{(pid=107812) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 04 00:57:13.518648 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': '3fa24970-97a7-4f46-ac55-0b24323fa402', 'device_id': '09132f2f-5f0d-4cf8-9e1a-20bdebe20ba1', 'network_id': '0405aef7-a260-406a-9f15-0b66416e7839', 'port_id': '3fa24970-97a7-4f46-ac55-0b24323fa402', 'mac_address': 'fa:16:3e:2d:46:ab', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 195, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'c9461236-5726-4fb5-be73-5965e5067b2c', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 00:57:13.519592 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: 3fa24970-97a7-4f46-ac55-0b24323fa402 {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 00:57:13.519903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 3fa24970-97a7-4f46-ac55-0b24323fa402 updated. Details: {'device': '3fa24970-97a7-4f46-ac55-0b24323fa402', 'device_id': '09132f2f-5f0d-4cf8-9e1a-20bdebe20ba1', 'network_id': '0405aef7-a260-406a-9f15-0b66416e7839', 'port_id': '3fa24970-97a7-4f46-ac55-0b24323fa402', 'mac_address': 'fa:16:3e:2d:46:ab', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 195, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'c9461236-5726-4fb5-be73-5965e5067b2c', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 1} Sep 04 00:57:13.520867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-3fa24970-97, col_values=(('tag', 1),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 00:57:13.521314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-3fa24970-97, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 00:57:13.521753 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-3fa24970-97, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 00:57:13.530193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-3fa24970-97, col_values=(('other_config', {'net_uuid': '0405aef7-a260-406a-9f15-0b66416e7839', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '1', 'segmentation_id': '195'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 00:57:13.540288 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade52db,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 3}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:57:13.540855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:18 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 2 devices currently available. Time elapsed: 0.022 Sep 04 00:57:13.541248 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Preparing device filters for 1 new devices {{(pid=107812) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 04 00:57:13.541549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Preparing filters for devices {'3fa24970-97a7-4f46-ac55-0b24323fa402'} Sep 04 00:57:13.542852 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information for ports dict_keys([]) {{(pid=107812) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 04 00:57:13.543171 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information {{(pid=107812) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 04 00:57:13.545108 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 2 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 00:57:13.592401 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[202932ad-8f3b-4745-ae3f-0d6820015a91]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 00:57:13.593019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:18 - agent port security group processed in 0.075 Sep 04 00:57:13.593624 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for 3fa24970-97a7-4f46-ac55-0b24323fa402 to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 00:57:13.828365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Configuration for devices up ['3fa24970-97a7-4f46-ac55-0b24323fa402'] and devices down [] completed. Sep 04 00:57:13.828835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:18 - ports processed. Elapsed:0.317 Sep 04 00:57:13.829291 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:18 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 0, 'removed': 0}}. Elapsed:0.318 Sep 04 00:57:13.880763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Resource Port 3fa24970-97a7-4f46-ac55-0b24323fa402 updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 00:57:13.881173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (3fa24970-97a7-4f46-ac55-0b24323fa402), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 00:57:14.175493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-8cf09c85-f259-40f1-9710-28e16261d13a demo admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T00:57:13Z,data_plane_status=None,description='',device_id='09132f2f-5f0d-4cf8-9e1a-20bdebe20ba1',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=85e5ae40-74c8-44fd-a057-a6dcb2b1601c,mac_address=fa:16:3e:6b:e2:cb,name='',network_id=e8e0564a-d5c9-4fe0-b2d4-538f45096708,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(85e5ae40-74c8-44fd-a057-a6dcb2b1601c),security_group_ids=set([]),status='DOWN',updated_at=2022-09-04T00:57:13Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 00:57:14.175961 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-8cf09c85-f259-40f1-9710-28e16261d13a demo admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (85e5ae40-74c8-44fd-a057-a6dcb2b1601c), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 00:57:15.512707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:19 started Sep 04 00:57:15.515482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade52dd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=907000000,duration_sec=44,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:57:15.516469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:57:15.516876 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:19 - starting polling. Elapsed:0.004 Sep 04 00:57:15.518149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 00:57:15.519487 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:19 - port information retrieved. Elapsed:0.007 Sep 04 00:57:15.519880 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Starting to process devices in:{'current': {'3fa24970-97a7-4f46-ac55-0b24323fa402', '89aa06b4-bbf1-40c2-bb48-500c3aecdf48'}, 'added': set(), 'removed': set(), 'updated': {'3fa24970-97a7-4f46-ac55-0b24323fa402'}, 're_added': set()} {{(pid=107812) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 04 00:57:15.520522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': '3fa24970-97a7-4f46-ac55-0b24323fa402', 'device_id': '09132f2f-5f0d-4cf8-9e1a-20bdebe20ba1', 'network_id': '0405aef7-a260-406a-9f15-0b66416e7839', 'port_id': '3fa24970-97a7-4f46-ac55-0b24323fa402', 'mac_address': 'fa:16:3e:2d:46:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 195, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'c9461236-5726-4fb5-be73-5965e5067b2c', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 00:57:15.521591 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: 3fa24970-97a7-4f46-ac55-0b24323fa402 {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 00:57:15.521984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 3fa24970-97a7-4f46-ac55-0b24323fa402 updated. Details: {'device': '3fa24970-97a7-4f46-ac55-0b24323fa402', 'device_id': '09132f2f-5f0d-4cf8-9e1a-20bdebe20ba1', 'network_id': '0405aef7-a260-406a-9f15-0b66416e7839', 'port_id': '3fa24970-97a7-4f46-ac55-0b24323fa402', 'mac_address': 'fa:16:3e:2d:46:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 195, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'c9461236-5726-4fb5-be73-5965e5067b2c', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 1} Sep 04 00:57:15.524129 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-3fa24970-97, col_values=(('tag', 1),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 00:57:15.524633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-3fa24970-97, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 00:57:15.525300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-3fa24970-97, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 00:57:15.525828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 00:57:15.526652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-3fa24970-97, col_values=(('other_config', {'net_uuid': '0405aef7-a260-406a-9f15-0b66416e7839', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '195', 'tag': '1'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 00:57:15.527450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 00:57:15.530401 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade52df,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 3}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:57:15.530815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:19 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 2 devices currently available. Time elapsed: 0.011 Sep 04 00:57:15.531246 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Refreshing firewall for 1 devices {{(pid=107812) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 04 00:57:15.531691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Refresh firewall rules Sep 04 00:57:15.534354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information for ports dict_keys([]) {{(pid=107812) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 04 00:57:15.534647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information {{(pid=107812) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 04 00:57:15.536951 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 2 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 00:57:15.585301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d508cbb-52f3-4560-963f-f71aeaa6e364]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 00:57:15.586192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:19 - agent port security group processed in 0.066 Sep 04 00:57:15.586708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for 3fa24970-97a7-4f46-ac55-0b24323fa402 to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 00:57:16.077235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Configuration for devices up ['3fa24970-97a7-4f46-ac55-0b24323fa402'] and devices down [] completed. Sep 04 00:57:16.077586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:19 - ports processed. Elapsed:0.565 Sep 04 00:57:16.077924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:19 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.565 Sep 04 00:57:16.320920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-84a08369-dee4-47d3-a6cf-540d7b0b128e None None] Resource Port 85e5ae40-74c8-44fd-a057-a6dcb2b1601c updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=85e5ae40-74c8-44fd-a057-a6dcb2b1601c,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=85e5ae40-74c8-44fd-a057-a6dcb2b1601c,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 00:57:16.321323 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-84a08369-dee4-47d3-a6cf-540d7b0b128e None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (85e5ae40-74c8-44fd-a057-a6dcb2b1601c), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 00:57:16.516910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-84a08369-dee4-47d3-a6cf-540d7b0b128e None None] Resource Port 85e5ae40-74c8-44fd-a057-a6dcb2b1601c updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=85e5ae40-74c8-44fd-a057-a6dcb2b1601c,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=85e5ae40-74c8-44fd-a057-a6dcb2b1601c,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=85e5ae40-74c8-44fd-a057-a6dcb2b1601c,segment=NetworkSegment(c26850af-ca47-4ea8-9a33-a34f3381800e),segment_id=c26850af-ca47-4ea8-9a33-a34f3381800e)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 00:57:16.517571 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-84a08369-dee4-47d3-a6cf-540d7b0b128e None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (85e5ae40-74c8-44fd-a057-a6dcb2b1601c), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 00:57:16.853328 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["d7856cc3-967a-4dbe-9bd2-f761d7b43a0a","insert","qg-85e5ae40-74",["set",[]],["map",[["attached-mac","fa:16:3e:6b:e2:cb"],["iface-id","85e5ae40-74c8-44fd-a057-a6dcb2b1601c"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 00:57:16.882184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["d7856cc3-967a-4dbe-9bd2-f761d7b43a0a","old",null,["set",[]],null],["","new","qg-85e5ae40-74",4,["map",[["attached-mac","fa:16:3e:6b:e2:cb"],["iface-id","85e5ae40-74c8-44fd-a057-a6dcb2b1601c"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 00:57:17.517783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:20 started Sep 04 00:57:17.517783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade52e1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=908000000,duration_sec=46,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:57:17.517783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:57:17.517783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:20 - starting polling. Elapsed:0.004 Sep 04 00:57:17.518504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 00:57:17.519447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:20 - port information retrieved. Elapsed:0.006 Sep 04 00:57:17.519766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Starting to process devices in:{'current': {'3fa24970-97a7-4f46-ac55-0b24323fa402', '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', '89aa06b4-bbf1-40c2-bb48-500c3aecdf48'}, 'added': {'85e5ae40-74c8-44fd-a057-a6dcb2b1601c'}, 'removed': set(), 'updated': {'85e5ae40-74c8-44fd-a057-a6dcb2b1601c'}, 're_added': set()} {{(pid=107812) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 04 00:57:17.520493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', 'device_id': '09132f2f-5f0d-4cf8-9e1a-20bdebe20ba1', 'network_id': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'port_id': '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', 'mac_address': 'fa:16:3e:6b:e2:cb', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '2b17f894-c374-4207-90ad-14f794c86627', 'ip_address': '172.37.7.235'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 00:57:17.521598 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: 85e5ae40-74c8-44fd-a057-a6dcb2b1601c {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 00:57:17.522454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 85e5ae40-74c8-44fd-a057-a6dcb2b1601c updated. Details: {'device': '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', 'device_id': '09132f2f-5f0d-4cf8-9e1a-20bdebe20ba1', 'network_id': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'port_id': '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', 'mac_address': 'fa:16:3e:6b:e2:cb', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '2b17f894-c374-4207-90ad-14f794c86627', 'ip_address': '172.37.7.235'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Sep 04 00:57:17.522787 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Assigning 2 as local vlan for net-id=e8e0564a-d5c9-4fe0-b2d4-538f45096708, seg-id=None Sep 04 00:57:17.525542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0x1fd38bef,OFPFlowMod(buffer_id=4294967295,command=0,cookie=6561907047025962751,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionPopVlan(len=8,type=18), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=32,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4098}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:57:17.528385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0xeade52e3,OFPFlowMod(buffer_id=4294967295,command=0,cookie=6887031442322345889,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionPushVlan(ethertype=33024,len=8,type=17), OFPActionSetField(vlan_vid=4098)],len=32,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 0}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:57:17.529422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-85e5ae40-74, col_values=(('tag', 2),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 00:57:17.529920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-85e5ae40-74, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 00:57:17.530502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-85e5ae40-74, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 00:57:17.539125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-85e5ae40-74, col_values=(('other_config', {'net_uuid': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 00:57:17.549387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade52e5,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 4}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:57:17.549734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:20 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 3 devices currently available. Time elapsed: 0.030 Sep 04 00:57:17.550089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Preparing device filters for 1 new devices {{(pid=107812) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 04 00:57:17.552979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Preparing filters for devices {'85e5ae40-74c8-44fd-a057-a6dcb2b1601c'} Sep 04 00:57:17.552979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information for ports dict_keys([]) {{(pid=107812) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 04 00:57:17.552979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information {{(pid=107812) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 04 00:57:17.553721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 2 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 00:57:17.591991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[e250e6ac-8dd8-403c-99cb-0e1c3b171e40]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 00:57:17.592617 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:20 - agent port security group processed in 0.072 Sep 04 00:57:17.593235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for 85e5ae40-74c8-44fd-a057-a6dcb2b1601c to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 00:57:17.804973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Configuration for devices up ['85e5ae40-74c8-44fd-a057-a6dcb2b1601c'] and devices down [] completed. Sep 04 00:57:17.805512 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:20 - ports processed. Elapsed:0.292 Sep 04 00:57:17.805847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:20 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.292 Sep 04 00:57:17.857806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Resource Port 85e5ae40-74c8-44fd-a057-a6dcb2b1601c updated (revision_number 3->4). Old fields: {'status': 'DOWN', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=85e5ae40-74c8-44fd-a057-a6dcb2b1601c,segment=NetworkSegment(c26850af-ca47-4ea8-9a33-a34f3381800e),segment_id=c26850af-ca47-4ea8-9a33-a34f3381800e)]} New fields: {'status': 'ACTIVE', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=85e5ae40-74c8-44fd-a057-a6dcb2b1601c,segment=NetworkSegment(c26850af-ca47-4ea8-9a33-a34f3381800e),segment_id=c26850af-ca47-4ea8-9a33-a34f3381800e)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 00:57:17.858588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (85e5ae40-74c8-44fd-a057-a6dcb2b1601c), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 00:57:19.515208 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:21 started Sep 04 00:57:19.517781 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade52e7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=909000000,duration_sec=48,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:57:19.518348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:57:19.518683 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:21 - starting polling. Elapsed:0.004 Sep 04 00:57:19.519825 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 00:57:19.521011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:21 - port information retrieved. Elapsed:0.006 Sep 04 00:57:19.521380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Starting to process devices in:{'current': {'3fa24970-97a7-4f46-ac55-0b24323fa402', '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', '89aa06b4-bbf1-40c2-bb48-500c3aecdf48'}, 'added': set(), 'removed': set(), 'updated': {'85e5ae40-74c8-44fd-a057-a6dcb2b1601c'}, 're_added': set()} {{(pid=107812) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 04 00:57:19.522026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', 'device_id': '09132f2f-5f0d-4cf8-9e1a-20bdebe20ba1', 'network_id': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'port_id': '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', 'mac_address': 'fa:16:3e:6b:e2:cb', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '2b17f894-c374-4207-90ad-14f794c86627', 'ip_address': '172.37.7.235'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 00:57:19.523123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: 85e5ae40-74c8-44fd-a057-a6dcb2b1601c {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 00:57:19.523444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 85e5ae40-74c8-44fd-a057-a6dcb2b1601c updated. Details: {'device': '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', 'device_id': '09132f2f-5f0d-4cf8-9e1a-20bdebe20ba1', 'network_id': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'port_id': '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', 'mac_address': 'fa:16:3e:6b:e2:cb', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '2b17f894-c374-4207-90ad-14f794c86627', 'ip_address': '172.37.7.235'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 04 00:57:19.524466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-85e5ae40-74, col_values=(('tag', 2),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 00:57:19.524874 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-85e5ae40-74, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 00:57:19.525295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-85e5ae40-74, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 00:57:19.525743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 00:57:19.526490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-85e5ae40-74, col_values=(('other_config', {'net_uuid': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 00:57:19.527131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 00:57:19.529218 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade52e9,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 4}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:57:19.529551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:21 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 3 devices currently available. Time elapsed: 0.008 Sep 04 00:57:19.529897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Refreshing firewall for 1 devices {{(pid=107812) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 04 00:57:19.530182 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Refresh firewall rules Sep 04 00:57:19.531284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information for ports dict_keys([]) {{(pid=107812) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 04 00:57:19.531572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information {{(pid=107812) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 04 00:57:19.533409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 2 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 00:57:19.570638 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad37e375-8b2d-44e5-b50f-33e3bce26c82]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 00:57:19.571268 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:21 - agent port security group processed in 0.050 Sep 04 00:57:19.571867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for 85e5ae40-74c8-44fd-a057-a6dcb2b1601c to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 00:57:19.717739 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Configuration for devices up ['85e5ae40-74c8-44fd-a057-a6dcb2b1601c'] and devices down [] completed. Sep 04 00:57:19.718112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:21 - ports processed. Elapsed:0.203 Sep 04 00:57:19.718449 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:21 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.203 Sep 04 00:57:21.516356 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:22 started Sep 04 00:57:21.520273 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade52eb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=911000000,duration_sec=50,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:57:21.521016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:57:21.521564 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:22 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 04 00:57:23.517408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:23 started Sep 04 00:57:23.520103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade52ed,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=911000000,duration_sec=52,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:57:23.520666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:57:23.521016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:23 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 00:57:25.523815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:24 started Sep 04 00:57:25.527504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade52ef,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=916000000,duration_sec=54,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:57:25.527504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:57:25.527504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:24 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 04 00:57:27.524000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:25 started Sep 04 00:57:27.528306 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade52f1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=920000000,duration_sec=56,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:57:27.529334 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:57:27.529909 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:25 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 04 00:57:29.525590 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:26 started Sep 04 00:57:29.527999 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade52f3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=920000000,duration_sec=58,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:57:29.528548 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:57:29.528892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:26 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 00:57:31.527176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:27 started Sep 04 00:57:31.529714 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade52f5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=921000000,duration_sec=60,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:57:31.530417 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:57:31.530878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:27 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 00:57:33.528681 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:28 started Sep 04 00:57:33.532974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade52f7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=924000000,duration_sec=62,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:57:33.534226 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:57:33.534797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:28 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 04 00:57:35.530387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:29 started Sep 04 00:57:35.534625 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade52f9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=925000000,duration_sec=64,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:57:35.535561 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:57:35.536225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:29 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 04 00:57:37.532602 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:30 started Sep 04 00:57:37.535217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade52fb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=927000000,duration_sec=66,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:57:37.535769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:57:37.536115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:30 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 00:57:39.533723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:31 started Sep 04 00:57:39.537947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade52fd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=929000000,duration_sec=68,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:57:39.538747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:57:39.539302 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:31 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 04 00:57:41.535624 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:32 started Sep 04 00:57:41.540313 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade52ff,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=931000000,duration_sec=70,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:57:41.541327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:57:41.542103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:32 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 04 00:57:43.537288 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:33 started Sep 04 00:57:43.539945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5301,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=931000000,duration_sec=72,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:57:43.540628 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:57:43.541064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:33 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 00:57:45.538196 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:34 started Sep 04 00:57:45.540702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5303,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=932000000,duration_sec=74,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:57:45.545897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:57:45.545897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:34 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 00:57:47.539238 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:35 started Sep 04 00:57:47.543063 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5305,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=934000000,duration_sec=76,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:57:47.543890 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:57:47.544392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:35 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 04 00:57:49.540618 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:36 started Sep 04 00:57:49.544668 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5307,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=935000000,duration_sec=78,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:57:49.562008 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:57:49.562008 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:36 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 04 00:57:51.541926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:37 started Sep 04 00:57:51.544600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5309,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=936000000,duration_sec=80,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:57:51.545198 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:57:51.545552 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:37 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 00:57:53.543439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:38 started Sep 04 00:57:53.546751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade530b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=938000000,duration_sec=82,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:57:53.547506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:57:53.547949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:38 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 04 00:57:55.544910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:39 started Sep 04 00:57:55.547444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade530d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=939000000,duration_sec=84,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:57:55.548122 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:57:55.548646 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:39 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 00:57:57.545778 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:40 started Sep 04 00:57:57.548905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade530f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=940000000,duration_sec=86,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:57:57.549577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:57:57.549929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:40 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 04 00:57:59.547238 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:41 started Sep 04 00:57:59.550889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5311,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=941000000,duration_sec=88,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:57:59.551457 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:57:59.551805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:41 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 04 00:58:01.548685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:42 started Sep 04 00:58:01.551622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5313,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=943000000,duration_sec=90,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:58:01.552197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:58:01.552554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:42 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 00:58:03.549822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:43 started Sep 04 00:58:03.552723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5315,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=944000000,duration_sec=92,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:58:03.553309 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:58:03.553666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:43 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 00:58:05.550976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:44 started Sep 04 00:58:05.555279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5317,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=946000000,duration_sec=94,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:58:05.556073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:58:05.560721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:44 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Sep 04 00:58:07.553636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:45 started Sep 04 00:58:07.557148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5319,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=948000000,duration_sec=96,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:58:07.558205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:58:07.558760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:45 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 04 00:58:09.555269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:46 started Sep 04 00:58:09.557890 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade531b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=949000000,duration_sec=98,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:58:09.558459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:58:09.558814 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:46 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 00:58:11.556402 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:47 started Sep 04 00:58:11.559183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade531d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=950000000,duration_sec=100,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:58:11.559997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:58:11.560438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:47 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 00:58:13.557905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:48 started Sep 04 00:58:13.560325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade531f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=952000000,duration_sec=102,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:58:13.560928 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:58:13.561260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:48 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 00:58:15.558844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:49 started Sep 04 00:58:15.561885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5321,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=953000000,duration_sec=104,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:58:15.562453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:58:15.562801 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:49 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 00:58:17.559604 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:50 started Sep 04 00:58:17.562734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5323,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=953000000,duration_sec=106,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:58:17.562734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:58:17.562734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:50 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 00:58:19.561203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:51 started Sep 04 00:58:19.563653 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5325,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=955000000,duration_sec=108,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:58:19.564209 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:58:19.564558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:51 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 00:58:21.562908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:52 started Sep 04 00:58:21.565495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5327,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=957000000,duration_sec=110,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:58:21.566073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:58:21.566417 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:52 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 00:58:23.563640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:53 started Sep 04 00:58:23.566090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5329,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=958000000,duration_sec=112,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:58:23.566646 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:58:23.567030 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:53 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 00:58:25.565162 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:54 started Sep 04 00:58:25.568154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade532b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=959000000,duration_sec=114,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:58:25.568722 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:58:25.569102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:54 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 00:58:27.565920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:55 started Sep 04 00:58:27.568372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade532d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=960000000,duration_sec=116,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:58:27.568934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:58:27.569512 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:55 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 00:58:29.566818 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:56 started Sep 04 00:58:29.569631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade532f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=961000000,duration_sec=118,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:58:29.570193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:58:29.570596 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:56 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 00:58:31.567980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:57 started Sep 04 00:58:31.570536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5331,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=962000000,duration_sec=120,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:58:31.571121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:58:31.571472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:57 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 00:58:33.569820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:58 started Sep 04 00:58:33.572547 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5333,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=964000000,duration_sec=122,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:58:33.573129 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:58:33.573538 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:58 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 00:58:35.571398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:59 started Sep 04 00:58:35.573803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5335,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=965000000,duration_sec=124,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:58:35.574364 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:58:35.574715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:59 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 00:58:37.571984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:60 started Sep 04 00:58:37.574309 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5337,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=966000000,duration_sec=126,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:58:37.574855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:58:37.575201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:60 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 00:58:39.572546 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:61 started Sep 04 00:58:39.579335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5339,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=967000000,duration_sec=128,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:58:39.579914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:58:39.580330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:61 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 04 00:58:41.574106 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:62 started Sep 04 00:58:41.576515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade533b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=968000000,duration_sec=130,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:58:41.577221 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:58:41.577807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:62 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 00:58:43.575734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:63 started Sep 04 00:58:43.578456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade533d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=970000000,duration_sec=132,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:58:43.579038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:58:43.579388 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:63 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 00:58:45.577136 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:64 started Sep 04 00:58:45.579540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade533f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=971000000,duration_sec=134,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:58:45.580099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:58:45.580486 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:64 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 00:58:46.275602 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-490ac8bf-c0a7-4796-94d1-d032f496f463 admin admin] Resource Subnet c9461236-5726-4fb5-be73-5965e5067b2c updated (revision_number 0->1). Old fields: {'dns_nameservers': []} New fields: {'dns_nameservers': [DNSNameServer(address='8.8.8.8',order=0,subnet_id=c9461236-5726-4fb5-be73-5965e5067b2c), DNSNameServer(address='8.8.4.4',order=1,subnet_id=c9461236-5726-4fb5-be73-5965e5067b2c)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 00:58:46.276178 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-490ac8bf-c0a7-4796-94d1-d032f496f463 admin admin] Publish callbacks [] for Subnet (c9461236-5726-4fb5-be73-5965e5067b2c), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 00:58:47.578182 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:65 started Sep 04 00:58:47.580446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5341,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=972000000,duration_sec=136,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:58:47.580997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:58:47.581987 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:65 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 00:58:49.579978 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:66 started Sep 04 00:58:49.582521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5343,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=974000000,duration_sec=138,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:58:49.583081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:58:49.583470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:66 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 00:58:51.580832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:67 started Sep 04 00:58:51.583303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5345,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=975000000,duration_sec=140,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:58:51.583875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:58:51.584230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:67 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 00:58:53.582207 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:68 started Sep 04 00:58:53.584627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5347,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=976000000,duration_sec=142,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:58:53.585214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:58:53.585567 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:68 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 00:58:55.582830 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:69 started Sep 04 00:58:55.586320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5349,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=978000000,duration_sec=144,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:58:55.586865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:58:55.587209 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:69 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 04 00:58:57.584040 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:70 started Sep 04 00:58:57.586455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade534b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=978000000,duration_sec=146,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:58:57.587004 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:58:57.587353 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:70 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 00:58:59.585234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:71 started Sep 04 00:58:59.587629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade534d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=979000000,duration_sec=148,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:58:59.588268 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:58:59.588713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:71 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 00:59:01.585996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:72 started Sep 04 00:59:01.588428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade534f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=980000000,duration_sec=150,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:59:01.589009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:59:01.589406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:72 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 00:59:03.586763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:73 started Sep 04 00:59:03.589505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5351,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=981000000,duration_sec=152,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:59:03.590110 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:59:03.590465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:73 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 00:59:05.587516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:74 started Sep 04 00:59:05.590396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5353,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=982000000,duration_sec=154,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:59:05.590994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:59:05.591310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:74 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 00:59:07.588629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:75 started Sep 04 00:59:07.591004 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5355,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=983000000,duration_sec=156,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:59:07.591587 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:59:07.591940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:75 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 00:59:09.589765 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:76 started Sep 04 00:59:09.592208 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5357,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=984000000,duration_sec=158,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:59:09.592750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:59:09.593117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:76 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 00:59:11.590460 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:77 started Sep 04 00:59:11.592928 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5359,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=984000000,duration_sec=160,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:59:11.593532 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:59:11.593884 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:77 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 00:59:13.592130 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:78 started Sep 04 00:59:13.594701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade535b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=986000000,duration_sec=162,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:59:13.595372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:59:13.595883 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:78 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 00:59:15.592357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:79 started Sep 04 00:59:15.594953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade535d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=986000000,duration_sec=164,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:59:15.595888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:59:15.596244 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:79 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 00:59:17.592994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:80 started Sep 04 00:59:17.596397 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade535f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=987000000,duration_sec=166,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:59:17.596976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:59:17.597351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:80 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 04 00:59:19.593737 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:81 started Sep 04 00:59:19.597015 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5361,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=988000000,duration_sec=168,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:59:19.597598 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:59:19.597951 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:81 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 00:59:21.595808 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:82 started Sep 04 00:59:21.598393 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5363,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=990000000,duration_sec=170,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:59:21.598941 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:59:21.599302 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:82 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 00:59:23.597031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:83 started Sep 04 00:59:23.599350 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5365,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=991000000,duration_sec=172,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:59:23.599932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:59:23.600282 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:83 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 00:59:25.598531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:84 started Sep 04 00:59:25.600989 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5367,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=993000000,duration_sec=174,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:59:25.601572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:59:25.601922 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:84 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 00:59:27.599640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:85 started Sep 04 00:59:27.602091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5369,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=994000000,duration_sec=176,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:59:27.602643 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:59:27.602992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:85 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 00:59:29.600447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:86 started Sep 04 00:59:29.602936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade536b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=994000000,duration_sec=178,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:59:29.603489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:59:29.603839 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:86 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 00:59:31.601396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:87 started Sep 04 00:59:31.603893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade536d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=995000000,duration_sec=180,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:59:31.604506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:59:31.604856 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:87 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 00:59:33.602841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:88 started Sep 04 00:59:33.605318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade536f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=997000000,duration_sec=182,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:59:33.605876 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:59:33.606225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:88 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 00:59:35.603556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:89 started Sep 04 00:59:35.606041 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5371,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=998000000,duration_sec=184,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:59:35.606592 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:59:35.606940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:89 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 00:59:37.604428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:90 started Sep 04 00:59:37.607383 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5373,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=999000000,duration_sec=186,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:59:37.607938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:59:37.608294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:90 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 00:59:39.605992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:91 started Sep 04 00:59:39.608312 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5375,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=0,duration_sec=189,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:59:39.608857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:59:39.609229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:91 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 00:59:41.607600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:92 started Sep 04 00:59:41.610594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5377,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=2000000,duration_sec=191,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:59:41.611147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:59:41.611493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:92 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 00:59:43.462324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-d73d0721-aaa6-4dbf-9c4a-8ca6bd4246cd admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-04T00:59:43Z,description='',dns_domain=None,id=4691c8cf-0c39-4045-a03b-ff5044c49d0a,mtu=1500,name='shared',project_id='f25649add4b1426590abafbe586fc1fa',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(4691c8cf-0c39-4045-a03b-ff5044c49d0a),segments=[NetworkSegment(4e19c3f3-3b44-45ba-bb23-f26c22c581ca)],shared=False,status='ACTIVE',updated_at=2022-09-04T00:59:43Z,vlan_transparent=) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 00:59:43.462963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-d73d0721-aaa6-4dbf-9c4a-8ca6bd4246cd admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533'] for Network (4691c8cf-0c39-4045-a03b-ff5044c49d0a), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 00:59:43.538481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager [None req-d73d0721-aaa6-4dbf-9c4a-8ca6bd4246cd admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 4691c8cf-0c39-4045-a03b-ff5044c49d0a with segmentation id not found. Sep 04 00:59:43.538481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 04 00:59:43.538481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 04 00:59:43.538481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 04 00:59:43.538481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 04 00:59:43.538481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 04 00:59:43.538481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 04 00:59:43.538481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 04 00:59:43.538481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 04 00:59:43.538481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 04 00:59:43.538481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 04 00:59:43.538481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 04 00:59:43.538481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 04 00:59:43.539456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 04 00:59:43.539456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 04 00:59:43.539456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 04 00:59:43.539456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 4691c8cf-0c39-4045-a03b-ff5044c49d0a with segmentation id not found. Sep 04 00:59:43.539456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager Sep 04 00:59:43.608880 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:93 started Sep 04 00:59:43.612132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5379,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=4000000,duration_sec=193,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:59:43.612725 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:59:43.613168 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:93 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 00:59:45.609973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:94 started Sep 04 00:59:45.612665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade537b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=4000000,duration_sec=195,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:59:45.613269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:59:45.613620 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:94 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 00:59:46.670693 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-a6d64149-01ef-4d94-8cf4-2c72017941c6 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(4be75d5f-dcc5-4bf9-8c88-63701aec7108)],cidr=192.168.233.0/24,created_at=2022-09-04T00:59:46Z,description='shared-subnet',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=192.168.233.1,host_routes=[],id=af176dda-46d0-442a-95d1-07972f29a71c,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='shared-subnet',network_id=4691c8cf-0c39-4045-a03b-ff5044c49d0a,project_id='f25649add4b1426590abafbe586fc1fa',revision_number=0,segment_id=,service_types=[],shared=True,subnetpool_id=,updated_at=2022-09-04T00:59:46Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 00:59:46.671332 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-a6d64149-01ef-4d94-8cf4-2c72017941c6 admin admin] Publish callbacks [] for Subnet (af176dda-46d0-442a-95d1-07972f29a71c), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 00:59:47.505153 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-8ed87ccb-3061-4dc4-90a0-d3660d77b899 None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T00:59:46Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-4691c8cf-0c39-4045-a03b-ff5044c49d0a',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=ca102ce7-433c-4029-aabf-33d944165ff1,mac_address=fa:16:3e:2d:72:12,name='',network_id=4691c8cf-0c39-4045-a03b-ff5044c49d0a,numa_affinity_policy=,project_id='f25649add4b1426590abafbe586fc1fa',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(ca102ce7-433c-4029-aabf-33d944165ff1),security_group_ids=set([]),status='DOWN',updated_at=2022-09-04T00:59:47Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 00:59:47.505543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-8ed87ccb-3061-4dc4-90a0-d3660d77b899 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (ca102ce7-433c-4029-aabf-33d944165ff1), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 00:59:47.610953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:95 started Sep 04 00:59:47.613561 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade537d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=5000000,duration_sec=197,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:59:47.617120 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:59:47.617120 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:95 - starting polling. Elapsed:0.004 Sep 04 00:59:47.617120 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 00:59:47.617120 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:95 - port information retrieved. Elapsed:0.006 Sep 04 00:59:47.617561 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:95 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 04 00:59:47.759113 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-8ed87ccb-3061-4dc4-90a0-d3660d77b899 None None] Resource Port ca102ce7-433c-4029-aabf-33d944165ff1 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=ca102ce7-433c-4029-aabf-33d944165ff1,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=ca102ce7-433c-4029-aabf-33d944165ff1,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=ca102ce7-433c-4029-aabf-33d944165ff1,segment=NetworkSegment(4e19c3f3-3b44-45ba-bb23-f26c22c581ca),segment_id=4e19c3f3-3b44-45ba-bb23-f26c22c581ca)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 00:59:47.759783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-8ed87ccb-3061-4dc4-90a0-d3660d77b899 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (ca102ce7-433c-4029-aabf-33d944165ff1), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 00:59:47.834482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["70ac0572-761b-4961-8953-65882c16a855","insert","tapca102ce7-43",["set",[]],["map",[["attached-mac","fa:16:3e:2d:72:12"],["iface-id","ca102ce7-433c-4029-aabf-33d944165ff1"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 00:59:47.862264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["70ac0572-761b-4961-8953-65882c16a855","old",null,["set",[]],null],["","new","tapca102ce7-43",5,["map",[["attached-mac","fa:16:3e:2d:72:12"],["iface-id","ca102ce7-433c-4029-aabf-33d944165ff1"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 00:59:48.924139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-6fde47b6-9464-4ea9-9e78-581836bb301a None None] Resource Port ca102ce7-433c-4029-aabf-33d944165ff1 updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 00:59:48.924756 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-6fde47b6-9464-4ea9-9e78-581836bb301a None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (ca102ce7-433c-4029-aabf-33d944165ff1), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 00:59:49.612093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:96 started Sep 04 00:59:49.614625 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade537f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=6000000,duration_sec=199,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:59:49.615457 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:59:49.615916 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:96 - starting polling. Elapsed:0.004 Sep 04 00:59:49.617260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 00:59:49.618566 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:96 - port information retrieved. Elapsed:0.007 Sep 04 00:59:49.618895 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Starting to process devices in:{'current': {'3fa24970-97a7-4f46-ac55-0b24323fa402', '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', '89aa06b4-bbf1-40c2-bb48-500c3aecdf48', 'ca102ce7-433c-4029-aabf-33d944165ff1'}, 'added': {'ca102ce7-433c-4029-aabf-33d944165ff1'}, 'removed': set(), 'updated': {'ca102ce7-433c-4029-aabf-33d944165ff1'}, 're_added': set()} {{(pid=107812) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 04 00:59:49.619450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': 'ca102ce7-433c-4029-aabf-33d944165ff1', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-4691c8cf-0c39-4045-a03b-ff5044c49d0a', 'network_id': '4691c8cf-0c39-4045-a03b-ff5044c49d0a', 'port_id': 'ca102ce7-433c-4029-aabf-33d944165ff1', 'mac_address': 'fa:16:3e:2d:72:12', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 161, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'af176dda-46d0-442a-95d1-07972f29a71c', 'ip_address': '192.168.233.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 00:59:49.620673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: ca102ce7-433c-4029-aabf-33d944165ff1 {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 00:59:49.621010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port ca102ce7-433c-4029-aabf-33d944165ff1 updated. Details: {'device': 'ca102ce7-433c-4029-aabf-33d944165ff1', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-4691c8cf-0c39-4045-a03b-ff5044c49d0a', 'network_id': '4691c8cf-0c39-4045-a03b-ff5044c49d0a', 'port_id': 'ca102ce7-433c-4029-aabf-33d944165ff1', 'mac_address': 'fa:16:3e:2d:72:12', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 161, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'af176dda-46d0-442a-95d1-07972f29a71c', 'ip_address': '192.168.233.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Sep 04 00:59:49.621375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Assigning 3 as local vlan for net-id=4691c8cf-0c39-4045-a03b-ff5044c49d0a, seg-id=161 Sep 04 00:59:49.623932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0x1fd38bf1,OFPFlowMod(buffer_id=4294967295,command=0,cookie=6561907047025962751,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4257), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4099}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:59:49.626868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0xeade5381,OFPFlowMod(buffer_id=4294967295,command=0,cookie=6887031442322345889,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4099)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4257}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:59:49.627827 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapca102ce7-43, col_values=(('tag', 3),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 00:59:49.628343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tapca102ce7-43, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 00:59:49.628817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tapca102ce7-43, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 00:59:49.633864 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapca102ce7-43, col_values=(('other_config', {'net_uuid': '4691c8cf-0c39-4045-a03b-ff5044c49d0a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '3', 'segmentation_id': '161'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 00:59:49.641226 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade5383,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 5}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:59:49.641667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:96 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 4 devices currently available. Time elapsed: 0.022 Sep 04 00:59:49.642019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Preparing device filters for 1 new devices {{(pid=107812) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 04 00:59:49.642317 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Preparing filters for devices {'ca102ce7-433c-4029-aabf-33d944165ff1'} Sep 04 00:59:49.643450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information for ports dict_keys([]) {{(pid=107812) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 04 00:59:49.643916 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information {{(pid=107812) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 04 00:59:49.645973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 2 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 00:59:49.681055 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f783a08-6faa-44d2-b23d-9231098b699f]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 00:59:49.681772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:96 - agent port security group processed in 0.063 Sep 04 00:59:49.682367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for ca102ce7-433c-4029-aabf-33d944165ff1 to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 00:59:49.814873 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Configuration for devices up ['ca102ce7-433c-4029-aabf-33d944165ff1'] and devices down [] completed. Sep 04 00:59:49.815270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:96 - ports processed. Elapsed:0.203 Sep 04 00:59:49.815670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:96 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.204 Sep 04 00:59:51.613328 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:97 started Sep 04 00:59:51.616212 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5385,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=7000000,duration_sec=201,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:59:51.616774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:59:51.617156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:97 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 00:59:53.613830 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:98 started Sep 04 00:59:53.616464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5387,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=8000000,duration_sec=203,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:59:53.617017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:59:53.617399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:98 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 00:59:55.614424 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:99 started Sep 04 00:59:55.617103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5389,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=9000000,duration_sec=205,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:59:55.617799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:59:55.618194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:99 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 00:59:57.615543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:100 started Sep 04 00:59:57.618763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade538b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=10000000,duration_sec=207,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:59:57.619313 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:59:57.619662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:100 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 04 00:59:59.615948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:101 started Sep 04 00:59:59.618381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade538d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=10000000,duration_sec=209,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 00:59:59.618926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 00:59:59.619266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:101 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:00:01.616977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:102 started Sep 04 01:00:01.619527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade538f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=11000000,duration_sec=211,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:00:01.620084 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:00:01.620439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:102 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:00:03.618312 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:103 started Sep 04 01:00:03.620689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5391,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=12000000,duration_sec=213,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:00:03.621270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:00:03.621615 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:103 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:00:05.619159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:104 started Sep 04 01:00:05.621934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5393,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=13000000,duration_sec=215,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:00:05.622497 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:00:05.622841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:104 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:00:07.620459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:105 started Sep 04 01:00:07.622964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5395,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=15000000,duration_sec=217,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:00:07.623547 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:00:07.623896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:105 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:00:09.621027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:106 started Sep 04 01:00:09.623467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5397,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=15000000,duration_sec=219,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:00:09.624289 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:00:09.624636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:106 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:00:11.622087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:107 started Sep 04 01:00:11.624552 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5399,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=16000000,duration_sec=221,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:00:11.625138 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:00:11.625488 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:107 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:00:13.622965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:108 started Sep 04 01:00:13.625349 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade539b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=17000000,duration_sec=223,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:00:13.625980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:00:13.626330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:108 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:00:15.623707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:109 started Sep 04 01:00:15.631173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade539d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=18000000,duration_sec=225,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:00:15.631760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:00:15.632117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:109 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 04 01:00:17.624390 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:110 started Sep 04 01:00:17.626914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade539f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=18000000,duration_sec=227,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:00:17.627470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:00:17.627816 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:110 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:00:19.625697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:111 started Sep 04 01:00:19.628422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade53a1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=20000000,duration_sec=229,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:00:19.628965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:00:19.629332 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:111 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:00:21.626221 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:112 started Sep 04 01:00:21.628535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade53a3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=20000000,duration_sec=231,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:00:21.629109 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:00:21.629454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:112 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:00:23.627147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:113 started Sep 04 01:00:23.629565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade53a5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=21000000,duration_sec=233,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:00:23.630374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:00:23.630729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:113 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:00:25.627801 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:114 started Sep 04 01:00:25.630241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade53a7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=22000000,duration_sec=235,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:00:25.630815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:00:25.631158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:114 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:00:27.629044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:115 started Sep 04 01:00:27.631802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade53a9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=23000000,duration_sec=237,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:00:27.632374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:00:27.632722 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:115 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:00:29.629893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:116 started Sep 04 01:00:29.632147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade53ab,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=24000000,duration_sec=239,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:00:29.632713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:00:29.633064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:116 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:00:31.631111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:117 started Sep 04 01:00:31.633755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade53ad,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=25000000,duration_sec=241,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:00:31.634303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:00:31.634685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:117 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:00:33.632583 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:118 started Sep 04 01:00:33.635541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade53af,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=27000000,duration_sec=243,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:00:33.636181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:00:33.636529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:118 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:00:35.634042 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:119 started Sep 04 01:00:35.636702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade53b1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=28000000,duration_sec=245,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:00:35.637343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:00:35.637754 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:119 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:00:37.635705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:120 started Sep 04 01:00:37.638293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade53b3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=30000000,duration_sec=247,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:00:37.638847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:00:37.639190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:120 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:00:39.636178 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:121 started Sep 04 01:00:39.638589 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade53b5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=30000000,duration_sec=249,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:00:39.639132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:00:39.639508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:121 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:00:41.637434 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:122 started Sep 04 01:00:41.641186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade53b7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=32000000,duration_sec=251,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:00:41.641758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:00:41.642132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:122 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 04 01:00:43.638254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:123 started Sep 04 01:00:43.641246 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade53b9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=32000000,duration_sec=253,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:00:43.641803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:00:43.642151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:123 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:00:45.639684 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:124 started Sep 04 01:00:45.642349 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade53bb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=34000000,duration_sec=255,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:00:45.642912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:00:45.643261 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:124 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:00:47.640929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:125 started Sep 04 01:00:47.643441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade53bd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=35000000,duration_sec=257,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:00:47.643993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:00:47.644342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:125 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:00:49.641460 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:126 started Sep 04 01:00:49.643807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade53bf,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=35000000,duration_sec=259,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:00:49.644366 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:00:49.644718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:126 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:00:51.642472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:127 started Sep 04 01:00:51.645110 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade53c1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=37000000,duration_sec=261,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:00:51.645688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:00:51.646018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:127 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:00:53.644024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:128 started Sep 04 01:00:53.646679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade53c3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=38000000,duration_sec=263,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:00:53.647299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:00:53.647641 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:128 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:00:55.645466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:129 started Sep 04 01:00:55.647915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade53c5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=39000000,duration_sec=265,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:00:55.648476 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:00:55.648828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:129 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:00:57.646263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:130 started Sep 04 01:00:57.653148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade53c7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=40000000,duration_sec=267,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:00:57.653730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:00:57.654602 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:130 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 04 01:00:59.647381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:131 started Sep 04 01:00:59.649899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade53c9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=41000000,duration_sec=269,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:00:59.650461 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:00:59.650808 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:131 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:01:01.648261 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:132 started Sep 04 01:01:01.650773 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade53cb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=42000000,duration_sec=271,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:01:01.651319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:01:01.651661 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:132 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:01:03.649904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:133 started Sep 04 01:01:03.652431 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade53cd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=44000000,duration_sec=273,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:01:03.652996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:01:03.653389 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:133 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:01:05.650739 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:134 started Sep 04 01:01:05.653289 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade53cf,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=45000000,duration_sec=275,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:01:05.654493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:01:05.654836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:134 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:01:07.652766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:135 started Sep 04 01:01:07.656055 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade53d1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=47000000,duration_sec=277,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:01:07.656697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:01:07.657046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:135 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:01:09.653686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:136 started Sep 04 01:01:09.656127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade53d3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=48000000,duration_sec=279,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:01:09.656694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:01:09.657043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:136 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:01:11.654834 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:137 started Sep 04 01:01:11.657218 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade53d5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=49000000,duration_sec=281,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:01:11.657764 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:01:11.658107 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:137 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:01:13.655492 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:138 started Sep 04 01:01:13.658046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade53d7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=50000000,duration_sec=283,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:01:13.658597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:01:13.658944 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:138 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:01:15.656776 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:139 started Sep 04 01:01:15.659223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade53d9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=51000000,duration_sec=285,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:01:15.666368 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:01:15.666727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:139 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Sep 04 01:01:17.658510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:140 started Sep 04 01:01:17.662904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade53db,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=54000000,duration_sec=287,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:01:17.663459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:01:17.663811 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:140 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 04 01:01:19.659269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:141 started Sep 04 01:01:19.661675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade53dd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=53000000,duration_sec=289,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:01:19.662235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:01:19.662590 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:141 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:01:21.660670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:142 started Sep 04 01:01:21.663064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade53df,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=55000000,duration_sec=291,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:01:21.663617 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:01:21.663962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:142 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:01:23.662141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:143 started Sep 04 01:01:23.664721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade53e1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=56000000,duration_sec=293,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:01:23.665329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:01:23.665679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:143 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:01:25.663557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:144 started Sep 04 01:01:25.666377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade53e3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=58000000,duration_sec=295,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:01:25.666937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:01:25.667321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:144 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:01:27.665266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:145 started Sep 04 01:01:27.667710 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade53e5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=59000000,duration_sec=297,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:01:27.668830 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:01:27.669219 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:145 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:01:29.666464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:146 started Sep 04 01:01:29.670108 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade53e7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=60000000,duration_sec=299,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:01:29.670663 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:01:29.671013 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:146 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 04 01:01:31.667750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:147 started Sep 04 01:01:31.670398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade53e9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=62000000,duration_sec=301,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:01:31.670960 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:01:31.671309 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:147 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:01:33.668884 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:148 started Sep 04 01:01:33.671368 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade53eb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=63000000,duration_sec=303,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:01:33.671933 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:01:33.672282 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:148 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:01:34.460567 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-d5feba4c-ffc9-4664-a501-49bc5997ebfd admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:01:34Z,description='Default security group',id=82dfa369-ba4c-4300-874d-6c1da065ae6d,is_default=True,name='default',project_id='e7e4ee55a7b245f5b2670340ddb85c47',revision_number=1,rules=[SecurityGroupRule(00d7d948-35e5-4f89-95e5-238cbf5e87c1),SecurityGroupRule(5820a77d-7036-41d6-a87e-7a576335bb5b),SecurityGroupRule(c8d15dc6-ac1c-423e-b293-b1ce61c91d5e),SecurityGroupRule(d4af91a9-48cd-47b5-8c10-4cb113585d16)],shared=False,stateful=True,updated_at=2022-09-04T01:01:34Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:01:34.461162 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-d5feba4c-ffc9-4664-a501-49bc5997ebfd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (82dfa369-ba4c-4300-874d-6c1da065ae6d), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:01:34.461899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-d5feba4c-ffc9-4664-a501-49bc5997ebfd admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:01:34Z,description=,direction='egress',ethertype='IPv6',id=00d7d948-35e5-4f89-95e5-238cbf5e87c1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e7e4ee55a7b245f5b2670340ddb85c47',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=82dfa369-ba4c-4300-874d-6c1da065ae6d,updated_at=2022-09-04T01:01:34Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:01:34.462473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-d5feba4c-ffc9-4664-a501-49bc5997ebfd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (00d7d948-35e5-4f89-95e5-238cbf5e87c1), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:01:34.462959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-d5feba4c-ffc9-4664-a501-49bc5997ebfd admin admin] Security group rule updated ['82dfa369-ba4c-4300-874d-6c1da065ae6d'] Sep 04 01:01:34.463826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-d5feba4c-ffc9-4664-a501-49bc5997ebfd admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:01:34Z,description=,direction='egress',ethertype='IPv4',id=5820a77d-7036-41d6-a87e-7a576335bb5b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e7e4ee55a7b245f5b2670340ddb85c47',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=82dfa369-ba4c-4300-874d-6c1da065ae6d,updated_at=2022-09-04T01:01:34Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:01:34.464247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-d5feba4c-ffc9-4664-a501-49bc5997ebfd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (5820a77d-7036-41d6-a87e-7a576335bb5b), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:01:34.464647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-d5feba4c-ffc9-4664-a501-49bc5997ebfd admin admin] Security group rule updated ['82dfa369-ba4c-4300-874d-6c1da065ae6d'] Sep 04 01:01:34.465604 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-d5feba4c-ffc9-4664-a501-49bc5997ebfd admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:01:34Z,description=,direction='ingress',ethertype='IPv6',id=c8d15dc6-ac1c-423e-b293-b1ce61c91d5e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e7e4ee55a7b245f5b2670340ddb85c47',protocol=,remote_address_group_id=,remote_group_id=82dfa369-ba4c-4300-874d-6c1da065ae6d,remote_ip_prefix=,revision_number=0,security_group_id=82dfa369-ba4c-4300-874d-6c1da065ae6d,updated_at=2022-09-04T01:01:34Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:01:34.466035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-d5feba4c-ffc9-4664-a501-49bc5997ebfd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (c8d15dc6-ac1c-423e-b293-b1ce61c91d5e), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:01:34.466424 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-d5feba4c-ffc9-4664-a501-49bc5997ebfd admin admin] Security group rule updated ['82dfa369-ba4c-4300-874d-6c1da065ae6d'] Sep 04 01:01:34.467186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-d5feba4c-ffc9-4664-a501-49bc5997ebfd admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:01:34Z,description=,direction='ingress',ethertype='IPv4',id=d4af91a9-48cd-47b5-8c10-4cb113585d16,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e7e4ee55a7b245f5b2670340ddb85c47',protocol=,remote_address_group_id=,remote_group_id=82dfa369-ba4c-4300-874d-6c1da065ae6d,remote_ip_prefix=,revision_number=0,security_group_id=82dfa369-ba4c-4300-874d-6c1da065ae6d,updated_at=2022-09-04T01:01:34Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:01:34.467602 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-d5feba4c-ffc9-4664-a501-49bc5997ebfd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (d4af91a9-48cd-47b5-8c10-4cb113585d16), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:01:34.467991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-d5feba4c-ffc9-4664-a501-49bc5997ebfd admin admin] Security group rule updated ['82dfa369-ba4c-4300-874d-6c1da065ae6d'] Sep 04 01:01:34.773031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-564fc75b-ada0-4a8b-8c49-be780db68604 admin admin] Resource SecurityGroup deleted: 82dfa369-ba4c-4300-874d-6c1da065ae6d {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:01:34.773670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-564fc75b-ada0-4a8b-8c49-be780db68604 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (82dfa369-ba4c-4300-874d-6c1da065ae6d), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:01:34.773941 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-564fc75b-ada0-4a8b-8c49-be780db68604 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('82dfa369-ba4c-4300-874d-6c1da065ae6d',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:01:34.794627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-564fc75b-ada0-4a8b-8c49-be780db68604 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('82dfa369-ba4c-4300-874d-6c1da065ae6d',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:01:34.795112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-564fc75b-ada0-4a8b-8c49-be780db68604 admin admin] Resource SecurityGroupRule deleted: 00d7d948-35e5-4f89-95e5-238cbf5e87c1 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:01:34.795553 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-564fc75b-ada0-4a8b-8c49-be780db68604 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (00d7d948-35e5-4f89-95e5-238cbf5e87c1), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:01:34.796065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-564fc75b-ada0-4a8b-8c49-be780db68604 admin admin] Security group rule updated ['82dfa369-ba4c-4300-874d-6c1da065ae6d'] Sep 04 01:01:34.796581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-564fc75b-ada0-4a8b-8c49-be780db68604 admin admin] Resource SecurityGroupRule deleted: 5820a77d-7036-41d6-a87e-7a576335bb5b {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:01:34.796964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-564fc75b-ada0-4a8b-8c49-be780db68604 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (5820a77d-7036-41d6-a87e-7a576335bb5b), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:01:34.797319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-564fc75b-ada0-4a8b-8c49-be780db68604 admin admin] Security group rule updated ['82dfa369-ba4c-4300-874d-6c1da065ae6d'] Sep 04 01:01:34.797741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-564fc75b-ada0-4a8b-8c49-be780db68604 admin admin] Resource SecurityGroupRule deleted: c8d15dc6-ac1c-423e-b293-b1ce61c91d5e {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:01:34.808588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-564fc75b-ada0-4a8b-8c49-be780db68604 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (c8d15dc6-ac1c-423e-b293-b1ce61c91d5e), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:01:34.808588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-564fc75b-ada0-4a8b-8c49-be780db68604 admin admin] Security group rule updated ['82dfa369-ba4c-4300-874d-6c1da065ae6d'] Sep 04 01:01:34.808588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-564fc75b-ada0-4a8b-8c49-be780db68604 admin admin] Resource SecurityGroupRule deleted: d4af91a9-48cd-47b5-8c10-4cb113585d16 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:01:34.808588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-564fc75b-ada0-4a8b-8c49-be780db68604 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (d4af91a9-48cd-47b5-8c10-4cb113585d16), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:01:34.808588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-564fc75b-ada0-4a8b-8c49-be780db68604 admin admin] Security group rule updated ['82dfa369-ba4c-4300-874d-6c1da065ae6d'] Sep 04 01:01:35.669894 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:149 started Sep 04 01:01:35.672691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade53ed,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=64000000,duration_sec=305,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:01:35.673297 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:01:35.673652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:149 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:01:37.671267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:150 started Sep 04 01:01:37.673738 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade53ef,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=65000000,duration_sec=307,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:01:37.674314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:01:37.674649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:150 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:01:39.672463 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:151 started Sep 04 01:01:39.674941 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade53f1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=66000000,duration_sec=309,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:01:39.675498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:01:39.675848 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:151 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:01:41.673658 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:152 started Sep 04 01:01:41.676262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade53f3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=68000000,duration_sec=311,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:01:41.676810 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:01:41.677196 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:152 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:01:43.674316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:153 started Sep 04 01:01:43.676693 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade53f5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=68000000,duration_sec=313,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:01:43.677300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:01:43.677728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:153 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:01:45.675143 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:154 started Sep 04 01:01:45.677787 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade53f7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=69000000,duration_sec=315,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:01:45.678331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:01:45.678676 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:154 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:01:47.676554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:155 started Sep 04 01:01:47.679369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade53f9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=71000000,duration_sec=317,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:01:47.679927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:01:47.680278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:155 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:01:49.677821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:156 started Sep 04 01:01:49.680065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade53fb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=72000000,duration_sec=319,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:01:49.680607 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:01:49.680947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:156 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:01:51.678799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:157 started Sep 04 01:01:51.681174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade53fd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=73000000,duration_sec=321,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:01:51.681730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:01:51.682078 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:157 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:01:53.680064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:158 started Sep 04 01:01:53.682701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade53ff,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=74000000,duration_sec=323,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:01:53.683260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:01:53.683630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:158 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:01:55.681392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:159 started Sep 04 01:01:55.683793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5401,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=75000000,duration_sec=325,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:01:55.684354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:01:55.684729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:159 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:01:57.682164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:160 started Sep 04 01:01:57.684609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5403,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=76000000,duration_sec=327,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:01:57.685925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:01:57.686229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:160 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:01:59.683187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:161 started Sep 04 01:01:59.685570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5405,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=77000000,duration_sec=329,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:01:59.686126 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:01:59.686470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:161 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:02:01.684582 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:162 started Sep 04 01:02:01.686957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5407,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=79000000,duration_sec=331,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:02:01.687507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:02:01.687850 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:162 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:02:03.685895 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:163 started Sep 04 01:02:03.688290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5409,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=80000000,duration_sec=333,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:02:03.688878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:02:03.689253 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:163 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:02:05.686835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:164 started Sep 04 01:02:05.689215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade540b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=81000000,duration_sec=335,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:02:05.689768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:02:05.690109 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:164 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:02:07.688926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:165 started Sep 04 01:02:07.690455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade540d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=82000000,duration_sec=337,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:02:07.691033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:02:07.691378 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:165 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:02:09.688590 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:166 started Sep 04 01:02:09.691038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade540f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=83000000,duration_sec=339,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:02:09.691600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:02:09.691956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:166 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:02:11.689334 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:167 started Sep 04 01:02:11.691646 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5411,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=83000000,duration_sec=341,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:02:11.692252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:02:11.692604 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:167 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:02:13.689909 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:168 started Sep 04 01:02:13.692643 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5413,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=84000000,duration_sec=343,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:02:13.693229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:02:13.693578 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:168 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:02:15.691370 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:169 started Sep 04 01:02:15.693730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5415,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=85000000,duration_sec=345,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:02:15.694281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:02:15.694623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:169 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:02:17.692732 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:170 started Sep 04 01:02:17.695515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5417,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=87000000,duration_sec=347,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:02:17.696073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:02:17.696421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:170 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:02:19.693575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:171 started Sep 04 01:02:19.696237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5419,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=88000000,duration_sec=349,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:02:19.696791 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:02:19.697158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:171 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:02:21.694699 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:172 started Sep 04 01:02:21.697027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade541b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=89000000,duration_sec=351,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:02:21.697602 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:02:21.697944 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:172 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:02:23.695396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:173 started Sep 04 01:02:23.697865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade541d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=89000000,duration_sec=353,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:02:23.698427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:02:23.698780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:173 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:02:25.696216 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:174 started Sep 04 01:02:25.698566 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade541f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=90000000,duration_sec=355,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:02:25.699153 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:02:25.699505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:174 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:02:27.697500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:175 started Sep 04 01:02:27.700563 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5421,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=92000000,duration_sec=357,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:02:27.701153 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:02:27.701508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:175 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:02:29.698118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:176 started Sep 04 01:02:29.700375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5423,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=92000000,duration_sec=359,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:02:29.700946 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:02:29.701299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:176 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:02:31.699138 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:177 started Sep 04 01:02:31.701896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5425,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=93000000,duration_sec=361,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:02:31.702464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:02:31.702814 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:177 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:02:33.700489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:178 started Sep 04 01:02:33.702911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5427,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=94000000,duration_sec=363,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:02:33.703472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:02:33.703847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:178 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:02:35.701592 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:179 started Sep 04 01:02:35.704013 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5429,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=96000000,duration_sec=365,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:02:35.704574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:02:35.704945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:179 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:02:37.702596 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:180 started Sep 04 01:02:37.704985 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade542b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=97000000,duration_sec=367,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:02:37.705571 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:02:37.705925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:180 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:02:39.703032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:181 started Sep 04 01:02:39.705399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade542d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=97000000,duration_sec=369,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:02:39.705984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:02:39.706332 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:181 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:02:41.704308 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:182 started Sep 04 01:02:41.706680 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade542f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=98000000,duration_sec=371,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:02:41.707223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:02:41.707592 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:182 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:02:43.705148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:183 started Sep 04 01:02:43.707619 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5431,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=99000000,duration_sec=373,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:02:43.708177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:02:43.708518 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:183 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:02:45.706320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:184 started Sep 04 01:02:45.708656 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5433,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=100000000,duration_sec=375,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:02:45.709235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:02:45.709581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:184 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:02:47.707357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:185 started Sep 04 01:02:47.709845 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5435,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=101000000,duration_sec=377,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:02:47.710428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:02:47.710773 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:185 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:02:49.708312 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:186 started Sep 04 01:02:49.710680 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5437,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=102000000,duration_sec=379,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:02:49.711127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:02:49.711495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:186 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:02:51.709630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:187 started Sep 04 01:02:51.712250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5439,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=104000000,duration_sec=381,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:02:51.712835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:02:51.713153 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:187 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:02:53.711331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:188 started Sep 04 01:02:53.714432 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade543b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=105000000,duration_sec=383,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:02:53.714979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:02:53.715331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:188 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:02:55.712195 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:189 started Sep 04 01:02:55.714715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade543d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=106000000,duration_sec=385,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:02:55.715274 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:02:55.715626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:189 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:02:57.713953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:190 started Sep 04 01:02:57.716380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade543f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=108000000,duration_sec=387,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:02:57.716921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:02:57.717298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:190 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:02:59.714506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:191 started Sep 04 01:02:59.716693 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5441,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=108000000,duration_sec=389,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:02:59.717279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:02:59.717629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:191 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:03:01.715222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:192 started Sep 04 01:03:01.717694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5443,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=109000000,duration_sec=391,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:03:01.718247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:03:01.718596 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:192 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:03:03.716318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:193 started Sep 04 01:03:03.718622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5445,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=110000000,duration_sec=393,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:03:03.719181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:03:03.719611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:193 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:03:05.717028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:194 started Sep 04 01:03:05.719485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5447,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=111000000,duration_sec=395,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:03:05.720044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:03:05.720392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:194 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:03:07.717884 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:195 started Sep 04 01:03:07.720217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5449,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=112000000,duration_sec=397,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:03:07.720813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:03:07.721197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:195 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:03:09.718689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:196 started Sep 04 01:03:09.721198 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade544b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=113000000,duration_sec=399,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:03:09.721833 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:03:09.722211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:196 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:03:11.719327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:197 started Sep 04 01:03:11.721698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade544d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=113000000,duration_sec=401,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:03:11.722284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:03:11.722663 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:197 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:03:13.720764 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:198 started Sep 04 01:03:13.723335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade544f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=115000000,duration_sec=403,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:03:13.723970 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:03:13.724321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:198 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:03:15.722058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:199 started Sep 04 01:03:15.724330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5451,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=116000000,duration_sec=405,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:03:15.724882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:03:15.725258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:199 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:03:17.723458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:200 started Sep 04 01:03:17.726057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5453,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=117000000,duration_sec=407,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:03:17.726824 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:03:17.727173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:200 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:03:19.724055 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:201 started Sep 04 01:03:19.726426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5455,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=118000000,duration_sec=409,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:03:19.726974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:03:19.727330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:201 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:03:21.724876 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:202 started Sep 04 01:03:21.727348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5457,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=119000000,duration_sec=411,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:03:21.728555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:03:21.728935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:202 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:03:23.725750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:203 started Sep 04 01:03:23.728663 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5459,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=120000000,duration_sec=413,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:03:23.729336 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:03:23.729684 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:203 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:03:25.726364 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:204 started Sep 04 01:03:25.729036 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade545b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=121000000,duration_sec=415,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:03:25.729701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:03:25.730123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:204 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:03:27.727549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:205 started Sep 04 01:03:27.730747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade545d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=122000000,duration_sec=417,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:03:27.731301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:03:27.731653 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:205 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:03:29.728083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:206 started Sep 04 01:03:29.730390 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade545f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=122000000,duration_sec=419,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:03:29.730977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:03:29.731357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:206 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:03:31.728513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:207 started Sep 04 01:03:31.731133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5461,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=123000000,duration_sec=421,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:03:31.731680 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:03:31.732030 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:207 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:03:33.729742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:208 started Sep 04 01:03:33.732134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5463,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=124000000,duration_sec=423,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:03:33.732743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:03:33.733099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:208 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:03:35.730877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:209 started Sep 04 01:03:35.733364 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5465,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=125000000,duration_sec=425,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:03:35.733984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:03:35.734336 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:209 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:03:37.732181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:210 started Sep 04 01:03:37.734573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5467,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=126000000,duration_sec=427,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:03:37.735133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:03:37.735484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:210 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:03:39.733376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:211 started Sep 04 01:03:39.735671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5469,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=127000000,duration_sec=429,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:03:39.736231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:03:39.736584 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:211 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:03:41.734630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:212 started Sep 04 01:03:41.737147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade546b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=129000000,duration_sec=431,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:03:41.737953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:03:41.738301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:212 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:03:43.735553 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:213 started Sep 04 01:03:43.738162 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade546d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=129000000,duration_sec=433,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:03:43.738721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:03:43.739070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:213 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:03:45.736195 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:214 started Sep 04 01:03:45.738782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade546f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=130000000,duration_sec=435,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:03:45.739340 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:03:45.739692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:214 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:03:47.736975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:215 started Sep 04 01:03:47.739979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5471,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=131000000,duration_sec=437,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:03:47.740540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:03:47.740891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:215 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:03:49.738092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:216 started Sep 04 01:03:49.740302 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5473,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=132000000,duration_sec=439,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:03:49.740861 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:03:49.741249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:216 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:03:51.739228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:217 started Sep 04 01:03:51.741561 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5475,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=133000000,duration_sec=441,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:03:51.742119 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:03:51.742458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:217 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:03:53.740047 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:218 started Sep 04 01:03:53.747418 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5477,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=134000000,duration_sec=443,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:03:53.747988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:03:53.748338 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:218 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 04 01:03:55.740975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:219 started Sep 04 01:03:55.743419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5479,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=135000000,duration_sec=445,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:03:55.743976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:03:55.744327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:219 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:03:57.742499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:220 started Sep 04 01:03:57.744889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade547b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=136000000,duration_sec=447,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:03:57.745543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:03:57.745894 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:220 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:03:59.743288 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:221 started Sep 04 01:03:59.745934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade547d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=137000000,duration_sec=449,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:03:59.746586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:03:59.747021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:221 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:04:01.744395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:222 started Sep 04 01:04:01.746740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade547f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=138000000,duration_sec=451,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:04:01.747295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:04:01.747645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:222 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:04:03.745268 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:223 started Sep 04 01:04:03.747797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5481,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=139000000,duration_sec=453,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:04:03.748343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:04:03.748696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:223 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:04:05.746714 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:224 started Sep 04 01:04:05.749320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5483,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=141000000,duration_sec=455,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:04:05.749871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:04:05.750215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:224 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:04:07.747439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:225 started Sep 04 01:04:07.749821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5485,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=141000000,duration_sec=457,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:04:07.750375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:04:07.750720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:225 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:04:09.748695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:226 started Sep 04 01:04:09.751434 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5487,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=143000000,duration_sec=459,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:04:09.751993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:04:09.752340 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:226 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:04:11.749185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:227 started Sep 04 01:04:11.751738 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5489,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=143000000,duration_sec=461,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:04:11.752374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:04:11.752791 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:227 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:04:13.749989 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:228 started Sep 04 01:04:13.753130 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade548b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=144000000,duration_sec=463,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:04:13.753859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:04:13.754268 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:228 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 04 01:04:15.750649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:229 started Sep 04 01:04:15.756298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade548d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=146000000,duration_sec=465,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:04:15.757871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:04:15.758583 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:229 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 04 01:04:17.752159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:230 started Sep 04 01:04:17.754508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade548f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=146000000,duration_sec=467,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:04:17.755068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:04:17.755413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:230 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:04:19.752973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:231 started Sep 04 01:04:19.755369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5491,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=147000000,duration_sec=469,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:04:19.755925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:04:19.756272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:231 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:04:21.753621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:232 started Sep 04 01:04:21.756275 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5493,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=148000000,duration_sec=471,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:04:21.756824 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:04:21.757312 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:232 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:04:23.755258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:233 started Sep 04 01:04:23.758374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5495,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=149000000,duration_sec=473,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:04:23.758923 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:04:23.759266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:233 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:04:25.756554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:234 started Sep 04 01:04:25.759618 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5497,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=151000000,duration_sec=475,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:04:25.760174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:04:25.760549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:234 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:04:27.758060 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:235 started Sep 04 01:04:27.764778 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5499,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=152000000,duration_sec=477,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:04:27.765360 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:04:27.765708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:235 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 04 01:04:29.758682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:236 started Sep 04 01:04:29.761108 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade549b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=153000000,duration_sec=479,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:04:29.761651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:04:29.762327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:236 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:04:31.769485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:237 started Sep 04 01:04:31.769485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade549d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=154000000,duration_sec=481,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:04:31.769485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:04:31.769485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:237 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:04:33.760620 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:238 started Sep 04 01:04:33.763004 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade549f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=155000000,duration_sec=483,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:04:33.763561 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:04:33.763904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:238 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:04:35.761949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:239 started Sep 04 01:04:35.764329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade54a1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=156000000,duration_sec=485,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:04:35.764886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:04:35.765315 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:239 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:04:37.763582 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:240 started Sep 04 01:04:37.766051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade54a3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=158000000,duration_sec=487,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:04:37.766604 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:04:37.766981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:240 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:04:39.764878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:241 started Sep 04 01:04:39.767306 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade54a5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=159000000,duration_sec=489,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:04:39.767858 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:04:39.768192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:241 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:04:41.766205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:242 started Sep 04 01:04:41.768678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade54a7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=160000000,duration_sec=491,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:04:41.769259 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:04:41.769611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:242 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:04:43.767054 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:243 started Sep 04 01:04:43.769638 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade54a9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=161000000,duration_sec=493,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:04:43.770222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:04:43.770571 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:243 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:04:45.768460 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:244 started Sep 04 01:04:45.770964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade54ab,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=162000000,duration_sec=495,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:04:45.771594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:04:45.771970 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:244 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:04:47.769224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:245 started Sep 04 01:04:47.772925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade54ad,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=164000000,duration_sec=497,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:04:47.773696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:04:47.774314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:245 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 04 01:04:49.777145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:246 started Sep 04 01:04:49.777145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade54af,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=164000000,duration_sec=499,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:04:49.777145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:04:49.777145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:246 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 04 01:04:51.770915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:247 started Sep 04 01:04:51.775151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade54b1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=166000000,duration_sec=501,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:04:51.775735 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:04:51.776226 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:247 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 04 01:04:52.999997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-f004dee6-6c3e-4e7e-b75e-b514c388d45b admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:04:52Z,description='Default security group',id=703cb105-947c-42c1-9237-d9f950459033,is_default=True,name='default',project_id='e07d8b14fef34e04a0410f12e5dbd2fe',revision_number=1,rules=[SecurityGroupRule(a55baf54-5af8-4373-b79a-d07ce8879a79),SecurityGroupRule(a9939108-1070-47c5-9724-561e7cc9ce6b),SecurityGroupRule(ce5cf9ce-37b8-4203-ae7c-f4d4d55d355b),SecurityGroupRule(e8a5e408-0f0d-442c-8e96-705ce85a7ab3)],shared=False,stateful=True,updated_at=2022-09-04T01:04:52Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:04:53.000620 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-f004dee6-6c3e-4e7e-b75e-b514c388d45b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (703cb105-947c-42c1-9237-d9f950459033), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:53.001016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-f004dee6-6c3e-4e7e-b75e-b514c388d45b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:04:52Z,description=,direction='ingress',ethertype='IPv6',id=a55baf54-5af8-4373-b79a-d07ce8879a79,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e07d8b14fef34e04a0410f12e5dbd2fe',protocol=,remote_address_group_id=,remote_group_id=703cb105-947c-42c1-9237-d9f950459033,remote_ip_prefix=,revision_number=0,security_group_id=703cb105-947c-42c1-9237-d9f950459033,updated_at=2022-09-04T01:04:52Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:04:53.001447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-f004dee6-6c3e-4e7e-b75e-b514c388d45b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (a55baf54-5af8-4373-b79a-d07ce8879a79), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:53.001779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-f004dee6-6c3e-4e7e-b75e-b514c388d45b admin admin] Security group rule updated ['703cb105-947c-42c1-9237-d9f950459033'] Sep 04 01:04:53.002528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-f004dee6-6c3e-4e7e-b75e-b514c388d45b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:04:52Z,description=,direction='ingress',ethertype='IPv4',id=a9939108-1070-47c5-9724-561e7cc9ce6b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e07d8b14fef34e04a0410f12e5dbd2fe',protocol=,remote_address_group_id=,remote_group_id=703cb105-947c-42c1-9237-d9f950459033,remote_ip_prefix=,revision_number=0,security_group_id=703cb105-947c-42c1-9237-d9f950459033,updated_at=2022-09-04T01:04:52Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:04:53.002882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-f004dee6-6c3e-4e7e-b75e-b514c388d45b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (a9939108-1070-47c5-9724-561e7cc9ce6b), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:53.003208 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-f004dee6-6c3e-4e7e-b75e-b514c388d45b admin admin] Security group rule updated ['703cb105-947c-42c1-9237-d9f950459033'] Sep 04 01:04:53.003899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-f004dee6-6c3e-4e7e-b75e-b514c388d45b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:04:52Z,description=,direction='egress',ethertype='IPv6',id=ce5cf9ce-37b8-4203-ae7c-f4d4d55d355b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e07d8b14fef34e04a0410f12e5dbd2fe',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=703cb105-947c-42c1-9237-d9f950459033,updated_at=2022-09-04T01:04:52Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:04:53.004247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-f004dee6-6c3e-4e7e-b75e-b514c388d45b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (ce5cf9ce-37b8-4203-ae7c-f4d4d55d355b), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:53.004568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-f004dee6-6c3e-4e7e-b75e-b514c388d45b admin admin] Security group rule updated ['703cb105-947c-42c1-9237-d9f950459033'] Sep 04 01:04:53.005276 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-f004dee6-6c3e-4e7e-b75e-b514c388d45b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:04:52Z,description=,direction='egress',ethertype='IPv4',id=e8a5e408-0f0d-442c-8e96-705ce85a7ab3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e07d8b14fef34e04a0410f12e5dbd2fe',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=703cb105-947c-42c1-9237-d9f950459033,updated_at=2022-09-04T01:04:52Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:04:53.005673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-f004dee6-6c3e-4e7e-b75e-b514c388d45b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (e8a5e408-0f0d-442c-8e96-705ce85a7ab3), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:53.006081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-f004dee6-6c3e-4e7e-b75e-b514c388d45b admin admin] Security group rule updated ['703cb105-947c-42c1-9237-d9f950459033'] Sep 04 01:04:53.202091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-f004dee6-6c3e-4e7e-b75e-b514c388d45b admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-04T01:04:52Z,description='',dns_domain=None,id=3b7528ba-1624-4915-b635-aeb0700ea8e7,mtu=1500,name='tempest-DeleteServersTestJSON-1909304110-network',project_id='e07d8b14fef34e04a0410f12e5dbd2fe',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(3b7528ba-1624-4915-b635-aeb0700ea8e7),segments=[NetworkSegment(fa03338c-c7bc-4666-a251-ff3dadbd2af6)],shared=False,status='ACTIVE',updated_at=2022-09-04T01:04:52Z,vlan_transparent=) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:04:53.202470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-f004dee6-6c3e-4e7e-b75e-b514c388d45b admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533'] for Network (3b7528ba-1624-4915-b635-aeb0700ea8e7), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:53.282580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager [None req-f004dee6-6c3e-4e7e-b75e-b514c388d45b admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 3b7528ba-1624-4915-b635-aeb0700ea8e7 with segmentation id not found. Sep 04 01:04:53.282580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 04 01:04:53.282580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 04 01:04:53.282580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 04 01:04:53.282580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 04 01:04:53.282580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 04 01:04:53.282580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 04 01:04:53.282580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 04 01:04:53.282580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 04 01:04:53.282580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 04 01:04:53.282580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 04 01:04:53.282580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 04 01:04:53.282580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 04 01:04:53.283491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 04 01:04:53.283491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 04 01:04:53.283491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 04 01:04:53.283491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 3b7528ba-1624-4915-b635-aeb0700ea8e7 with segmentation id not found. Sep 04 01:04:53.283491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager Sep 04 01:04:53.633796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-2f79b47d-07f7-4ea7-a5bc-ab07608a05e9 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(ad631b87-8dba-424e-acbb-6d24f48b4e32)],cidr=172.20.0.0/28,created_at=2022-09-04T01:04:53Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=46f76b48-bc1e-4bf9-b91c-49408437f259,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-DeleteServersTestJSON-1909304110-subnet',network_id=3b7528ba-1624-4915-b635-aeb0700ea8e7,project_id='e07d8b14fef34e04a0410f12e5dbd2fe',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-04T01:04:53Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:04:53.634394 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-2f79b47d-07f7-4ea7-a5bc-ab07608a05e9 admin admin] Publish callbacks [] for Subnet (46f76b48-bc1e-4bf9-b91c-49408437f259), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:53.771894 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:248 started Sep 04 01:04:53.774537 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade54b3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=166000000,duration_sec=503,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:04:53.775317 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:04:53.775888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:248 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:04:54.401589 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-7681c969-c4a0-4a2b-85e4-81572ed8dd04 None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:04:53Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-3b7528ba-1624-4915-b635-aeb0700ea8e7',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=9b82da41-d694-43b0-a43b-5998addaf0bf,mac_address=fa:16:3e:3b:22:50,name='',network_id=3b7528ba-1624-4915-b635-aeb0700ea8e7,numa_affinity_policy=,project_id='e07d8b14fef34e04a0410f12e5dbd2fe',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(9b82da41-d694-43b0-a43b-5998addaf0bf),security_group_ids=set([]),status='DOWN',updated_at=2022-09-04T01:04:54Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:04:54.402713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-7681c969-c4a0-4a2b-85e4-81572ed8dd04 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (9b82da41-d694-43b0-a43b-5998addaf0bf), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:54.689466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-7681c969-c4a0-4a2b-85e4-81572ed8dd04 None None] Resource Port 9b82da41-d694-43b0-a43b-5998addaf0bf updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=9b82da41-d694-43b0-a43b-5998addaf0bf,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=9b82da41-d694-43b0-a43b-5998addaf0bf,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=9b82da41-d694-43b0-a43b-5998addaf0bf,segment=NetworkSegment(fa03338c-c7bc-4666-a251-ff3dadbd2af6),segment_id=fa03338c-c7bc-4666-a251-ff3dadbd2af6)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:04:54.689466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-7681c969-c4a0-4a2b-85e4-81572ed8dd04 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (9b82da41-d694-43b0-a43b-5998addaf0bf), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:54.836863 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-27b789ee-f770-4ea3-918a-27b48c4d1900 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:04:54Z,description='Default security group',id=421f3fc5-37dd-45fe-9d09-0151fc3a66b2,is_default=True,name='default',project_id='55faed42b7f243df9df879d581797f56',revision_number=1,rules=[SecurityGroupRule(416a0bfa-f39b-4e3c-967d-d5929230a9c9),SecurityGroupRule(4294e6e8-5268-4fa8-ba5a-cd3d69e46403),SecurityGroupRule(765e4f1c-9b1d-4ac6-9b58-b6786c5fb728),SecurityGroupRule(83eeee27-d67e-43b3-9d4c-1fdbc220c340)],shared=False,stateful=True,updated_at=2022-09-04T01:04:54Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:04:54.837553 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-27b789ee-f770-4ea3-918a-27b48c4d1900 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (421f3fc5-37dd-45fe-9d09-0151fc3a66b2), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:54.837975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-27b789ee-f770-4ea3-918a-27b48c4d1900 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:04:54Z,description=,direction='egress',ethertype='IPv4',id=416a0bfa-f39b-4e3c-967d-d5929230a9c9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='55faed42b7f243df9df879d581797f56',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=421f3fc5-37dd-45fe-9d09-0151fc3a66b2,updated_at=2022-09-04T01:04:54Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:04:54.838399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-27b789ee-f770-4ea3-918a-27b48c4d1900 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (416a0bfa-f39b-4e3c-967d-d5929230a9c9), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:54.838678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-27b789ee-f770-4ea3-918a-27b48c4d1900 admin admin] Security group rule updated ['421f3fc5-37dd-45fe-9d09-0151fc3a66b2'] Sep 04 01:04:54.839409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-27b789ee-f770-4ea3-918a-27b48c4d1900 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:04:54Z,description=,direction='ingress',ethertype='IPv4',id=4294e6e8-5268-4fa8-ba5a-cd3d69e46403,normalized_cidr=None,port_range_max=,port_range_min=,project_id='55faed42b7f243df9df879d581797f56',protocol=,remote_address_group_id=,remote_group_id=421f3fc5-37dd-45fe-9d09-0151fc3a66b2,remote_ip_prefix=,revision_number=0,security_group_id=421f3fc5-37dd-45fe-9d09-0151fc3a66b2,updated_at=2022-09-04T01:04:54Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:04:54.839771 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-27b789ee-f770-4ea3-918a-27b48c4d1900 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (4294e6e8-5268-4fa8-ba5a-cd3d69e46403), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:54.840109 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-27b789ee-f770-4ea3-918a-27b48c4d1900 admin admin] Security group rule updated ['421f3fc5-37dd-45fe-9d09-0151fc3a66b2'] Sep 04 01:04:54.840947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-27b789ee-f770-4ea3-918a-27b48c4d1900 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:04:54Z,description=,direction='egress',ethertype='IPv6',id=765e4f1c-9b1d-4ac6-9b58-b6786c5fb728,normalized_cidr=None,port_range_max=,port_range_min=,project_id='55faed42b7f243df9df879d581797f56',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=421f3fc5-37dd-45fe-9d09-0151fc3a66b2,updated_at=2022-09-04T01:04:54Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:04:54.841281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-27b789ee-f770-4ea3-918a-27b48c4d1900 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (765e4f1c-9b1d-4ac6-9b58-b6786c5fb728), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:54.841621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-27b789ee-f770-4ea3-918a-27b48c4d1900 admin admin] Security group rule updated ['421f3fc5-37dd-45fe-9d09-0151fc3a66b2'] Sep 04 01:04:54.842339 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-27b789ee-f770-4ea3-918a-27b48c4d1900 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:04:54Z,description=,direction='ingress',ethertype='IPv6',id=83eeee27-d67e-43b3-9d4c-1fdbc220c340,normalized_cidr=None,port_range_max=,port_range_min=,project_id='55faed42b7f243df9df879d581797f56',protocol=,remote_address_group_id=,remote_group_id=421f3fc5-37dd-45fe-9d09-0151fc3a66b2,remote_ip_prefix=,revision_number=0,security_group_id=421f3fc5-37dd-45fe-9d09-0151fc3a66b2,updated_at=2022-09-04T01:04:54Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:04:54.842700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-27b789ee-f770-4ea3-918a-27b48c4d1900 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (83eeee27-d67e-43b3-9d4c-1fdbc220c340), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:54.843036 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-27b789ee-f770-4ea3-918a-27b48c4d1900 admin admin] Security group rule updated ['421f3fc5-37dd-45fe-9d09-0151fc3a66b2'] Sep 04 01:04:54.927831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["a90a2884-b490-42e0-ac4b-e206ce63e14f","insert","tap9b82da41-d6",["set",[]],["map",[["attached-mac","fa:16:3e:3b:22:50"],["iface-id","9b82da41-d694-43b0-a43b-5998addaf0bf"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:04:55.066011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["a90a2884-b490-42e0-ac4b-e206ce63e14f","old",null,["set",[]],null],["","new","tap9b82da41-d6",6,["map",[["attached-mac","fa:16:3e:3b:22:50"],["iface-id","9b82da41-d694-43b0-a43b-5998addaf0bf"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:04:55.381275 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-27b789ee-f770-4ea3-918a-27b48c4d1900 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-04T01:04:54Z,description='',dns_domain=None,id=3e702e6e-ebe1-46a7-b30d-f3d140ac2993,mtu=1500,name='tempest-AttachVolumeShelveTestJSON-167828011-network',project_id='55faed42b7f243df9df879d581797f56',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(3e702e6e-ebe1-46a7-b30d-f3d140ac2993),segments=[NetworkSegment(294bd754-f77e-4dd5-a8a8-fa66c41ba024)],shared=False,status='ACTIVE',updated_at=2022-09-04T01:04:54Z,vlan_transparent=) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:04:55.384670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-27b789ee-f770-4ea3-918a-27b48c4d1900 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533'] for Network (3e702e6e-ebe1-46a7-b30d-f3d140ac2993), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:55.491435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager [None req-27b789ee-f770-4ea3-918a-27b48c4d1900 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 3e702e6e-ebe1-46a7-b30d-f3d140ac2993 with segmentation id not found. Sep 04 01:04:55.491435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 04 01:04:55.491435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 04 01:04:55.491435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 04 01:04:55.491435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 04 01:04:55.491435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 04 01:04:55.491435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 04 01:04:55.491435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 04 01:04:55.491435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 04 01:04:55.491435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 04 01:04:55.491435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 04 01:04:55.491435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 04 01:04:55.491435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 04 01:04:55.492868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 04 01:04:55.492868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 04 01:04:55.492868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 04 01:04:55.492868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 3e702e6e-ebe1-46a7-b30d-f3d140ac2993 with segmentation id not found. Sep 04 01:04:55.492868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager Sep 04 01:04:55.510747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-25ce9458-2fa7-48f8-9db1-5307eea1a85d admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:04:54Z,description='Default security group',id=012b1c46-d5d0-4a92-9c0b-abcec93f605b,is_default=True,name='default',project_id='e7dca68418a14d7da9aa63ac25f202e8',revision_number=1,rules=[SecurityGroupRule(28d523e4-89f2-433c-8d56-58320374e80b),SecurityGroupRule(5123bd42-1cda-41c8-9a39-91e030680699),SecurityGroupRule(859006e7-dbdd-44dd-837a-a89ace669c03),SecurityGroupRule(c2e404ef-9d8c-4552-992f-c7d111af9790)],shared=False,stateful=True,updated_at=2022-09-04T01:04:55Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:04:55.512411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-25ce9458-2fa7-48f8-9db1-5307eea1a85d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (012b1c46-d5d0-4a92-9c0b-abcec93f605b), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:55.513612 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-25ce9458-2fa7-48f8-9db1-5307eea1a85d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:04:55Z,description=,direction='egress',ethertype='IPv6',id=28d523e4-89f2-433c-8d56-58320374e80b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e7dca68418a14d7da9aa63ac25f202e8',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=012b1c46-d5d0-4a92-9c0b-abcec93f605b,updated_at=2022-09-04T01:04:55Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:04:55.514907 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-25ce9458-2fa7-48f8-9db1-5307eea1a85d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (28d523e4-89f2-433c-8d56-58320374e80b), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:55.516490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-25ce9458-2fa7-48f8-9db1-5307eea1a85d admin admin] Security group rule updated ['012b1c46-d5d0-4a92-9c0b-abcec93f605b'] Sep 04 01:04:55.519309 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-25ce9458-2fa7-48f8-9db1-5307eea1a85d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:04:55Z,description=,direction='egress',ethertype='IPv4',id=5123bd42-1cda-41c8-9a39-91e030680699,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e7dca68418a14d7da9aa63ac25f202e8',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=012b1c46-d5d0-4a92-9c0b-abcec93f605b,updated_at=2022-09-04T01:04:55Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:04:55.519827 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-25ce9458-2fa7-48f8-9db1-5307eea1a85d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (5123bd42-1cda-41c8-9a39-91e030680699), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:55.520270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-25ce9458-2fa7-48f8-9db1-5307eea1a85d admin admin] Security group rule updated ['012b1c46-d5d0-4a92-9c0b-abcec93f605b'] Sep 04 01:04:55.526214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-25ce9458-2fa7-48f8-9db1-5307eea1a85d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:04:55Z,description=,direction='ingress',ethertype='IPv4',id=859006e7-dbdd-44dd-837a-a89ace669c03,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e7dca68418a14d7da9aa63ac25f202e8',protocol=,remote_address_group_id=,remote_group_id=012b1c46-d5d0-4a92-9c0b-abcec93f605b,remote_ip_prefix=,revision_number=0,security_group_id=012b1c46-d5d0-4a92-9c0b-abcec93f605b,updated_at=2022-09-04T01:04:55Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:04:55.526214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-25ce9458-2fa7-48f8-9db1-5307eea1a85d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (859006e7-dbdd-44dd-837a-a89ace669c03), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:55.526214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-25ce9458-2fa7-48f8-9db1-5307eea1a85d admin admin] Security group rule updated ['012b1c46-d5d0-4a92-9c0b-abcec93f605b'] Sep 04 01:04:55.555640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-25ce9458-2fa7-48f8-9db1-5307eea1a85d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:04:55Z,description=,direction='ingress',ethertype='IPv6',id=c2e404ef-9d8c-4552-992f-c7d111af9790,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e7dca68418a14d7da9aa63ac25f202e8',protocol=,remote_address_group_id=,remote_group_id=012b1c46-d5d0-4a92-9c0b-abcec93f605b,remote_ip_prefix=,revision_number=0,security_group_id=012b1c46-d5d0-4a92-9c0b-abcec93f605b,updated_at=2022-09-04T01:04:55Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:04:55.556815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-25ce9458-2fa7-48f8-9db1-5307eea1a85d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (c2e404ef-9d8c-4552-992f-c7d111af9790), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:55.558435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-25ce9458-2fa7-48f8-9db1-5307eea1a85d admin admin] Security group rule updated ['012b1c46-d5d0-4a92-9c0b-abcec93f605b'] Sep 04 01:04:55.677434 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-e49f2cb1-4184-45c3-8768-2ef892f6b40d admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:04:55Z,description='Default security group',id=258c239a-16c7-45ea-bf27-4f76d118a726,is_default=True,name='default',project_id='db72b63281384bd883b04d05bcc35677',revision_number=1,rules=[SecurityGroupRule(21815125-ca4b-4da3-9ec7-532ddbd87938),SecurityGroupRule(43ae738d-3093-40be-9760-0cd0522375c6),SecurityGroupRule(c491b2d5-dc59-43ba-9b19-60d3cf620719),SecurityGroupRule(efd900ab-5216-449c-865c-0b8e1f25b0be)],shared=False,stateful=True,updated_at=2022-09-04T01:04:55Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:04:55.679648 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-e49f2cb1-4184-45c3-8768-2ef892f6b40d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (258c239a-16c7-45ea-bf27-4f76d118a726), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:55.680322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-e49f2cb1-4184-45c3-8768-2ef892f6b40d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:04:55Z,description=,direction='ingress',ethertype='IPv6',id=21815125-ca4b-4da3-9ec7-532ddbd87938,normalized_cidr=None,port_range_max=,port_range_min=,project_id='db72b63281384bd883b04d05bcc35677',protocol=,remote_address_group_id=,remote_group_id=258c239a-16c7-45ea-bf27-4f76d118a726,remote_ip_prefix=,revision_number=0,security_group_id=258c239a-16c7-45ea-bf27-4f76d118a726,updated_at=2022-09-04T01:04:55Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:04:55.680696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-e49f2cb1-4184-45c3-8768-2ef892f6b40d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (21815125-ca4b-4da3-9ec7-532ddbd87938), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:55.681044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-e49f2cb1-4184-45c3-8768-2ef892f6b40d admin admin] Security group rule updated ['258c239a-16c7-45ea-bf27-4f76d118a726'] Sep 04 01:04:55.681807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-e49f2cb1-4184-45c3-8768-2ef892f6b40d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:04:55Z,description=,direction='egress',ethertype='IPv6',id=43ae738d-3093-40be-9760-0cd0522375c6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='db72b63281384bd883b04d05bcc35677',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=258c239a-16c7-45ea-bf27-4f76d118a726,updated_at=2022-09-04T01:04:55Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:04:55.685430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-e49f2cb1-4184-45c3-8768-2ef892f6b40d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (43ae738d-3093-40be-9760-0cd0522375c6), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:55.685783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-e49f2cb1-4184-45c3-8768-2ef892f6b40d admin admin] Security group rule updated ['258c239a-16c7-45ea-bf27-4f76d118a726'] Sep 04 01:04:55.691543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-e49f2cb1-4184-45c3-8768-2ef892f6b40d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:04:55Z,description=,direction='ingress',ethertype='IPv4',id=c491b2d5-dc59-43ba-9b19-60d3cf620719,normalized_cidr=None,port_range_max=,port_range_min=,project_id='db72b63281384bd883b04d05bcc35677',protocol=,remote_address_group_id=,remote_group_id=258c239a-16c7-45ea-bf27-4f76d118a726,remote_ip_prefix=,revision_number=0,security_group_id=258c239a-16c7-45ea-bf27-4f76d118a726,updated_at=2022-09-04T01:04:55Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:04:55.693213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-e49f2cb1-4184-45c3-8768-2ef892f6b40d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (c491b2d5-dc59-43ba-9b19-60d3cf620719), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:55.695469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-e49f2cb1-4184-45c3-8768-2ef892f6b40d admin admin] Security group rule updated ['258c239a-16c7-45ea-bf27-4f76d118a726'] Sep 04 01:04:55.696784 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-e49f2cb1-4184-45c3-8768-2ef892f6b40d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:04:55Z,description=,direction='egress',ethertype='IPv4',id=efd900ab-5216-449c-865c-0b8e1f25b0be,normalized_cidr=None,port_range_max=,port_range_min=,project_id='db72b63281384bd883b04d05bcc35677',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=258c239a-16c7-45ea-bf27-4f76d118a726,updated_at=2022-09-04T01:04:55Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:04:55.702221 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-e49f2cb1-4184-45c3-8768-2ef892f6b40d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (efd900ab-5216-449c-865c-0b8e1f25b0be), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:55.702221 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-e49f2cb1-4184-45c3-8768-2ef892f6b40d admin admin] Security group rule updated ['258c239a-16c7-45ea-bf27-4f76d118a726'] Sep 04 01:04:55.773231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:249 started Sep 04 01:04:55.775954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade54b5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=167000000,duration_sec=505,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:04:55.776910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:04:55.777408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:249 - starting polling. Elapsed:0.004 Sep 04 01:04:55.779336 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:55.781029 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:249 - port information retrieved. Elapsed:0.008 Sep 04 01:04:55.781584 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Starting to process devices in:{'current': {'3fa24970-97a7-4f46-ac55-0b24323fa402', '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', '9b82da41-d694-43b0-a43b-5998addaf0bf', '89aa06b4-bbf1-40c2-bb48-500c3aecdf48', 'ca102ce7-433c-4029-aabf-33d944165ff1'}, 'added': {'9b82da41-d694-43b0-a43b-5998addaf0bf'}, 'removed': set(), 'updated': {'9b82da41-d694-43b0-a43b-5998addaf0bf'}, 're_added': set()} {{(pid=107812) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 04 01:04:55.782171 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': '9b82da41-d694-43b0-a43b-5998addaf0bf', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-3b7528ba-1624-4915-b635-aeb0700ea8e7', 'network_id': '3b7528ba-1624-4915-b635-aeb0700ea8e7', 'port_id': '9b82da41-d694-43b0-a43b-5998addaf0bf', 'mac_address': 'fa:16:3e:3b:22:50', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 158, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '46f76b48-bc1e-4bf9-b91c-49408437f259', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 01:04:55.784411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: 9b82da41-d694-43b0-a43b-5998addaf0bf {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:04:55.785563 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 9b82da41-d694-43b0-a43b-5998addaf0bf updated. Details: {'device': '9b82da41-d694-43b0-a43b-5998addaf0bf', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-3b7528ba-1624-4915-b635-aeb0700ea8e7', 'network_id': '3b7528ba-1624-4915-b635-aeb0700ea8e7', 'port_id': '9b82da41-d694-43b0-a43b-5998addaf0bf', 'mac_address': 'fa:16:3e:3b:22:50', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 158, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '46f76b48-bc1e-4bf9-b91c-49408437f259', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Sep 04 01:04:55.788870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Assigning 4 as local vlan for net-id=3b7528ba-1624-4915-b635-aeb0700ea8e7, seg-id=158 Sep 04 01:04:55.797696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0x1fd38bf3,OFPFlowMod(buffer_id=4294967295,command=0,cookie=6561907047025962751,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4254), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4100}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:04:55.808011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0xeade54b7,OFPFlowMod(buffer_id=4294967295,command=0,cookie=6887031442322345889,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4100)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4254}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:04:55.811127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap9b82da41-d6, col_values=(('tag', 4),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:04:55.813458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap9b82da41-d6, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:04:55.817386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap9b82da41-d6, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:04:55.837267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap9b82da41-d6, col_values=(('other_config', {'net_uuid': '3b7528ba-1624-4915-b635-aeb0700ea8e7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '4', 'segmentation_id': '158'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:04:55.853739 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade54b9,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 6}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:04:55.854101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:249 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 5 devices currently available. Time elapsed: 0.072 Sep 04 01:04:55.854461 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Preparing device filters for 1 new devices {{(pid=107812) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 04 01:04:55.854966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Preparing filters for devices {'9b82da41-d694-43b0-a43b-5998addaf0bf'} Sep 04 01:04:55.860824 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information for ports dict_keys([]) {{(pid=107812) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 04 01:04:55.862867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information {{(pid=107812) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 04 01:04:55.873243 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 2 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:04:55.901796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c62bafe1-6bee-4b58-8e7d-49c0ff47b56e admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:04:54Z,data_plane_status=None,description='',device_id='a8e13541-9272-4fa2-a9ff-940907d6ba01',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=3c278ab2-dc61-40f8-ab29-c8cc8b740d7d,mac_address=fa:16:3e:92:fb:aa,name='',network_id=e8e0564a-d5c9-4fe0-b2d4-538f45096708,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(3c278ab2-dc61-40f8-ab29-c8cc8b740d7d),security_group_ids=set([]),status='DOWN',updated_at=2022-09-04T01:04:55Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:04:55.902435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-c62bafe1-6bee-4b58-8e7d-49c0ff47b56e admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (3c278ab2-dc61-40f8-ab29-c8cc8b740d7d), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:55.913367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-d5925f92-6dae-44da-a7d9-4bb4b3853700 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:04:55Z,description='Default security group',id=c2e0c046-51c9-480b-a3a5-5ef5152d3e20,is_default=True,name='default',project_id='287d111f08ac4b05bd5adec9c40d0620',revision_number=1,rules=[SecurityGroupRule(16f515a0-eb55-4745-8585-e03f2631f7b2),SecurityGroupRule(37b5ff1d-528c-40aa-b261-11fc8a2898f1),SecurityGroupRule(4a262980-9824-4576-8271-d44359329c08),SecurityGroupRule(8633977c-c2b2-410f-9c6e-16f9bf70a2c7)],shared=False,stateful=True,updated_at=2022-09-04T01:04:55Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:04:55.914004 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-d5925f92-6dae-44da-a7d9-4bb4b3853700 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (c2e0c046-51c9-480b-a3a5-5ef5152d3e20), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:55.914864 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-d5925f92-6dae-44da-a7d9-4bb4b3853700 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:04:55Z,description=,direction='egress',ethertype='IPv4',id=16f515a0-eb55-4745-8585-e03f2631f7b2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='287d111f08ac4b05bd5adec9c40d0620',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c2e0c046-51c9-480b-a3a5-5ef5152d3e20,updated_at=2022-09-04T01:04:55Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:04:55.917425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-d5925f92-6dae-44da-a7d9-4bb4b3853700 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (16f515a0-eb55-4745-8585-e03f2631f7b2), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:55.917806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-d5925f92-6dae-44da-a7d9-4bb4b3853700 admin admin] Security group rule updated ['c2e0c046-51c9-480b-a3a5-5ef5152d3e20'] Sep 04 01:04:55.976360 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89ca33a-9aa9-486e-a47d-c3e16e8a1018]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:04:55.976899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:249 - agent port security group processed in 0.195 Sep 04 01:04:55.977552 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for 9b82da41-d694-43b0-a43b-5998addaf0bf to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 01:04:55.983980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-d5925f92-6dae-44da-a7d9-4bb4b3853700 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:04:55Z,description=,direction='egress',ethertype='IPv6',id=37b5ff1d-528c-40aa-b261-11fc8a2898f1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='287d111f08ac4b05bd5adec9c40d0620',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c2e0c046-51c9-480b-a3a5-5ef5152d3e20,updated_at=2022-09-04T01:04:55Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:04:55.984165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-d5925f92-6dae-44da-a7d9-4bb4b3853700 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (37b5ff1d-528c-40aa-b261-11fc8a2898f1), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:55.987770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-d5925f92-6dae-44da-a7d9-4bb4b3853700 admin admin] Security group rule updated ['c2e0c046-51c9-480b-a3a5-5ef5152d3e20'] Sep 04 01:04:55.988272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-d5925f92-6dae-44da-a7d9-4bb4b3853700 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:04:55Z,description=,direction='ingress',ethertype='IPv6',id=4a262980-9824-4576-8271-d44359329c08,normalized_cidr=None,port_range_max=,port_range_min=,project_id='287d111f08ac4b05bd5adec9c40d0620',protocol=,remote_address_group_id=,remote_group_id=c2e0c046-51c9-480b-a3a5-5ef5152d3e20,remote_ip_prefix=,revision_number=0,security_group_id=c2e0c046-51c9-480b-a3a5-5ef5152d3e20,updated_at=2022-09-04T01:04:55Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:04:55.988637 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-d5925f92-6dae-44da-a7d9-4bb4b3853700 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (4a262980-9824-4576-8271-d44359329c08), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:55.989119 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-d5925f92-6dae-44da-a7d9-4bb4b3853700 admin admin] Security group rule updated ['c2e0c046-51c9-480b-a3a5-5ef5152d3e20'] Sep 04 01:04:55.989882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-d5925f92-6dae-44da-a7d9-4bb4b3853700 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:04:55Z,description=,direction='ingress',ethertype='IPv4',id=8633977c-c2b2-410f-9c6e-16f9bf70a2c7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='287d111f08ac4b05bd5adec9c40d0620',protocol=,remote_address_group_id=,remote_group_id=c2e0c046-51c9-480b-a3a5-5ef5152d3e20,remote_ip_prefix=,revision_number=0,security_group_id=c2e0c046-51c9-480b-a3a5-5ef5152d3e20,updated_at=2022-09-04T01:04:55Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:04:55.990238 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-d5925f92-6dae-44da-a7d9-4bb4b3853700 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (8633977c-c2b2-410f-9c6e-16f9bf70a2c7), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:55.990652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-d5925f92-6dae-44da-a7d9-4bb4b3853700 admin admin] Security group rule updated ['c2e0c046-51c9-480b-a3a5-5ef5152d3e20'] Sep 04 01:04:56.054509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-2ba111f9-8e1a-4662-9850-e8452c8479e7 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:04:55Z,description='Default security group',id=89d52eba-7e8a-41cf-b307-526f1c6f9c54,is_default=True,name='default',project_id='8cd5d05953314eaab3d768e33897858f',revision_number=1,rules=[SecurityGroupRule(322ab5db-ddef-4149-9e66-2ee7594df429),SecurityGroupRule(7d38a421-3c6a-42d7-b5ab-ebd157f82330),SecurityGroupRule(83164e75-cf0c-4d55-b817-410efecea70a),SecurityGroupRule(e2946542-766f-4913-98a8-39d36832b0ad)],shared=False,stateful=True,updated_at=2022-09-04T01:04:55Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:04:56.054894 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-2ba111f9-8e1a-4662-9850-e8452c8479e7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (89d52eba-7e8a-41cf-b307-526f1c6f9c54), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:56.055673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-2ba111f9-8e1a-4662-9850-e8452c8479e7 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:04:55Z,description=,direction='ingress',ethertype='IPv6',id=322ab5db-ddef-4149-9e66-2ee7594df429,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8cd5d05953314eaab3d768e33897858f',protocol=,remote_address_group_id=,remote_group_id=89d52eba-7e8a-41cf-b307-526f1c6f9c54,remote_ip_prefix=,revision_number=0,security_group_id=89d52eba-7e8a-41cf-b307-526f1c6f9c54,updated_at=2022-09-04T01:04:55Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:04:56.056088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-2ba111f9-8e1a-4662-9850-e8452c8479e7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (322ab5db-ddef-4149-9e66-2ee7594df429), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:56.056797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-2ba111f9-8e1a-4662-9850-e8452c8479e7 admin admin] Security group rule updated ['89d52eba-7e8a-41cf-b307-526f1c6f9c54'] Sep 04 01:04:56.451200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-2ba111f9-8e1a-4662-9850-e8452c8479e7 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:04:55Z,description=,direction='ingress',ethertype='IPv4',id=7d38a421-3c6a-42d7-b5ab-ebd157f82330,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8cd5d05953314eaab3d768e33897858f',protocol=,remote_address_group_id=,remote_group_id=89d52eba-7e8a-41cf-b307-526f1c6f9c54,remote_ip_prefix=,revision_number=0,security_group_id=89d52eba-7e8a-41cf-b307-526f1c6f9c54,updated_at=2022-09-04T01:04:55Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:04:56.451200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-2ba111f9-8e1a-4662-9850-e8452c8479e7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (7d38a421-3c6a-42d7-b5ab-ebd157f82330), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:56.451200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-2ba111f9-8e1a-4662-9850-e8452c8479e7 admin admin] Security group rule updated ['89d52eba-7e8a-41cf-b307-526f1c6f9c54'] Sep 04 01:04:56.462325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-2ba111f9-8e1a-4662-9850-e8452c8479e7 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:04:55Z,description=,direction='egress',ethertype='IPv4',id=83164e75-cf0c-4d55-b817-410efecea70a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8cd5d05953314eaab3d768e33897858f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=89d52eba-7e8a-41cf-b307-526f1c6f9c54,updated_at=2022-09-04T01:04:55Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:04:56.462325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-2ba111f9-8e1a-4662-9850-e8452c8479e7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (83164e75-cf0c-4d55-b817-410efecea70a), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:56.462325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-2ba111f9-8e1a-4662-9850-e8452c8479e7 admin admin] Security group rule updated ['89d52eba-7e8a-41cf-b307-526f1c6f9c54'] Sep 04 01:04:56.466640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-2ba111f9-8e1a-4662-9850-e8452c8479e7 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:04:55Z,description=,direction='egress',ethertype='IPv6',id=e2946542-766f-4913-98a8-39d36832b0ad,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8cd5d05953314eaab3d768e33897858f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=89d52eba-7e8a-41cf-b307-526f1c6f9c54,updated_at=2022-09-04T01:04:55Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:04:56.466640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-2ba111f9-8e1a-4662-9850-e8452c8479e7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (e2946542-766f-4913-98a8-39d36832b0ad), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:56.466640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-2ba111f9-8e1a-4662-9850-e8452c8479e7 admin admin] Security group rule updated ['89d52eba-7e8a-41cf-b307-526f1c6f9c54'] Sep 04 01:04:56.474440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-25ce9458-2fa7-48f8-9db1-5307eea1a85d admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-04T01:04:55Z,description='',dns_domain=None,id=1fb5aed8-696d-4f87-8b2a-7d29744538a8,mtu=1500,name='tempest-AttachVolumeTestJSON-364832789-network',project_id='e7dca68418a14d7da9aa63ac25f202e8',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(1fb5aed8-696d-4f87-8b2a-7d29744538a8),segments=[NetworkSegment(79b84dcb-99f6-4af2-ac73-30fcaae597f6)],shared=False,status='ACTIVE',updated_at=2022-09-04T01:04:55Z,vlan_transparent=) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:04:56.474440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-25ce9458-2fa7-48f8-9db1-5307eea1a85d admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533'] for Network (1fb5aed8-696d-4f87-8b2a-7d29744538a8), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:56.476731 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-d5925f92-6dae-44da-a7d9-4bb4b3853700 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-04T01:04:55Z,description='',dns_domain=None,id=d7f39628-666e-4480-8bee-49de183d5e09,mtu=1500,name='tempest-AttachVolumeNegativeTest-1875369034-network',project_id='287d111f08ac4b05bd5adec9c40d0620',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(d7f39628-666e-4480-8bee-49de183d5e09),segments=[NetworkSegment(929a573e-75ef-46ab-9889-4a31869bd81c)],shared=False,status='ACTIVE',updated_at=2022-09-04T01:04:55Z,vlan_transparent=) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:04:56.476731 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-d5925f92-6dae-44da-a7d9-4bb4b3853700 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533'] for Network (d7f39628-666e-4480-8bee-49de183d5e09), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:56.593768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-e49f2cb1-4184-45c3-8768-2ef892f6b40d admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-04T01:04:55Z,description='',dns_domain=None,id=b16f22e1-6fb1-440b-98eb-845123e960e6,mtu=1500,name='tempest-ServerRescueNegativeTestJSON-389120141-network',project_id='db72b63281384bd883b04d05bcc35677',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(b16f22e1-6fb1-440b-98eb-845123e960e6),segments=[NetworkSegment(c1d2cfbc-d3d5-4bd8-9da5-bc22dc7bb131)],shared=False,status='ACTIVE',updated_at=2022-09-04T01:04:55Z,vlan_transparent=) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:04:56.594394 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-e49f2cb1-4184-45c3-8768-2ef892f6b40d admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533'] for Network (b16f22e1-6fb1-440b-98eb-845123e960e6), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:56.596557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager [None req-d5925f92-6dae-44da-a7d9-4bb4b3853700 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network d7f39628-666e-4480-8bee-49de183d5e09 with segmentation id not found. Sep 04 01:04:56.596557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 04 01:04:56.596557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 04 01:04:56.596557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 04 01:04:56.596557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 04 01:04:56.596557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 04 01:04:56.596557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 04 01:04:56.596557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 04 01:04:56.596557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 04 01:04:56.596557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 04 01:04:56.596557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 04 01:04:56.596557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 04 01:04:56.596557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 04 01:04:56.597370 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 04 01:04:56.597370 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 04 01:04:56.597370 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 04 01:04:56.597370 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network d7f39628-666e-4480-8bee-49de183d5e09 with segmentation id not found. Sep 04 01:04:56.597370 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager Sep 04 01:04:56.761827 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Configuration for devices up ['9b82da41-d694-43b0-a43b-5998addaf0bf'] and devices down [] completed. Sep 04 01:04:56.762147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:249 - ports processed. Elapsed:0.989 Sep 04 01:04:56.762482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:249 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.989 Sep 04 01:04:56.820725 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-76f08abf-7973-4669-b0a9-33e25b719eca admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(e2b5c735-e647-437e-b975-d8d217293f52)],cidr=172.20.0.0/28,created_at=2022-09-04T01:04:56Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=b8f8e824-5e09-4bb6-bfba-faf43aae1f44,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-AttachVolumeShelveTestJSON-167828011-subnet',network_id=3e702e6e-ebe1-46a7-b30d-f3d140ac2993,project_id='55faed42b7f243df9df879d581797f56',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-04T01:04:56Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:04:56.821372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-76f08abf-7973-4669-b0a9-33e25b719eca admin admin] Publish callbacks [] for Subnet (b8f8e824-5e09-4bb6-bfba-faf43aae1f44), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:56.890510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager [None req-25ce9458-2fa7-48f8-9db1-5307eea1a85d admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 1fb5aed8-696d-4f87-8b2a-7d29744538a8 with segmentation id not found. Sep 04 01:04:56.890510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 04 01:04:56.890510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 04 01:04:56.890510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 04 01:04:56.890510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 04 01:04:56.890510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 04 01:04:56.890510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 04 01:04:56.890510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 04 01:04:56.890510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 04 01:04:56.890510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 04 01:04:56.890510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 04 01:04:56.890510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 04 01:04:56.890510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 04 01:04:56.891259 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 04 01:04:56.891259 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 04 01:04:56.891259 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 04 01:04:56.891259 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 1fb5aed8-696d-4f87-8b2a-7d29744538a8 with segmentation id not found. Sep 04 01:04:56.891259 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager Sep 04 01:04:56.897159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-2ba111f9-8e1a-4662-9850-e8452c8479e7 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-04T01:04:55Z,description='',dns_domain=None,id=bb66909c-9291-477a-9f2b-a9f4b56d351c,mtu=1500,name='tempest-EncryptedVolumesExtendAttachedTest-487990549-network',project_id='8cd5d05953314eaab3d768e33897858f',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(bb66909c-9291-477a-9f2b-a9f4b56d351c),segments=[NetworkSegment(3af2c02d-18a0-4624-a8f5-965163bd84c8)],shared=False,status='ACTIVE',updated_at=2022-09-04T01:04:56Z,vlan_transparent=) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:04:56.897859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-2ba111f9-8e1a-4662-9850-e8452c8479e7 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533'] for Network (bb66909c-9291-477a-9f2b-a9f4b56d351c), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:56.924621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager [None req-e49f2cb1-4184-45c3-8768-2ef892f6b40d admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network b16f22e1-6fb1-440b-98eb-845123e960e6 with segmentation id not found. Sep 04 01:04:56.924621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 04 01:04:56.924621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 04 01:04:56.924621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 04 01:04:56.924621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 04 01:04:56.924621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 04 01:04:56.924621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 04 01:04:56.924621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 04 01:04:56.924621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 04 01:04:56.924621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 04 01:04:56.924621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 04 01:04:56.924621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 04 01:04:56.924621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 04 01:04:56.925395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 04 01:04:56.925395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 04 01:04:56.925395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 04 01:04:56.925395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network b16f22e1-6fb1-440b-98eb-845123e960e6 with segmentation id not found. Sep 04 01:04:56.925395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager Sep 04 01:04:57.082482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-a2859e3b-e819-4f4f-9529-87c6039f5839 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(fc3797d5-9b72-495b-ad87-6672defaffaf)],cidr=172.20.0.0/28,created_at=2022-09-04T01:04:56Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=cf87fd90-4193-4f02-8ccd-ce8ccea66ca5,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-AttachVolumeTestJSON-364832789-subnet',network_id=1fb5aed8-696d-4f87-8b2a-7d29744538a8,project_id='e7dca68418a14d7da9aa63ac25f202e8',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-04T01:04:56Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:04:57.084777 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-a2859e3b-e819-4f4f-9529-87c6039f5839 admin admin] Publish callbacks [] for Subnet (cf87fd90-4193-4f02-8ccd-ce8ccea66ca5), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:57.139363 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Resource Port 9b82da41-d694-43b0-a43b-5998addaf0bf updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:04:57.141170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (9b82da41-d694-43b0-a43b-5998addaf0bf), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:57.153237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager [None req-2ba111f9-8e1a-4662-9850-e8452c8479e7 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network bb66909c-9291-477a-9f2b-a9f4b56d351c with segmentation id not found. Sep 04 01:04:57.153237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 04 01:04:57.153237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 04 01:04:57.153237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 04 01:04:57.153237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 04 01:04:57.153237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 04 01:04:57.153237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 04 01:04:57.153237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 04 01:04:57.153237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 04 01:04:57.153237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 04 01:04:57.153237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 04 01:04:57.153237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 04 01:04:57.153237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 04 01:04:57.158361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 04 01:04:57.158361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 04 01:04:57.158361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 04 01:04:57.158361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network bb66909c-9291-477a-9f2b-a9f4b56d351c with segmentation id not found. Sep 04 01:04:57.158361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager Sep 04 01:04:57.410568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-aa358601-e561-4254-801a-dc4f6eec0677 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(3654991d-0b66-41d2-941d-8067df33eb73)],cidr=172.20.0.0/28,created_at=2022-09-04T01:04:56Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=35ea244b-d6a3-4c9a-a9b3-3f9d2814dee0,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-ServerRescueNegativeTestJSON-389120141-subnet',network_id=b16f22e1-6fb1-440b-98eb-845123e960e6,project_id='db72b63281384bd883b04d05bcc35677',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-04T01:04:56Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:04:57.411229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-aa358601-e561-4254-801a-dc4f6eec0677 admin admin] Publish callbacks [] for Subnet (35ea244b-d6a3-4c9a-a9b3-3f9d2814dee0), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:57.518865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-ad8b3b68-3d10-4e06-b4c4-a6ff4a7c8073 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:04:57Z,description='Default security group',id=5e680e58-21bf-4966-8fab-a680be3c9685,is_default=True,name='default',project_id='cd838d15487d45ae99751bc557b4a742',revision_number=1,rules=[SecurityGroupRule(33c5f7e6-304d-4749-a6db-9174541de430),SecurityGroupRule(6455b78c-0a42-486a-a941-68e3ffc1f276),SecurityGroupRule(d1985c68-c7d1-471b-91ea-08a3e16b869c),SecurityGroupRule(ebb3096d-0d21-4d63-8396-944ced4c28f7)],shared=False,stateful=True,updated_at=2022-09-04T01:04:57Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:04:57.519487 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-ad8b3b68-3d10-4e06-b4c4-a6ff4a7c8073 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (5e680e58-21bf-4966-8fab-a680be3c9685), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:57.520110 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-ad8b3b68-3d10-4e06-b4c4-a6ff4a7c8073 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:04:57Z,description=,direction='egress',ethertype='IPv6',id=33c5f7e6-304d-4749-a6db-9174541de430,normalized_cidr=None,port_range_max=,port_range_min=,project_id='cd838d15487d45ae99751bc557b4a742',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=5e680e58-21bf-4966-8fab-a680be3c9685,updated_at=2022-09-04T01:04:57Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:04:57.520473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-ad8b3b68-3d10-4e06-b4c4-a6ff4a7c8073 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (33c5f7e6-304d-4749-a6db-9174541de430), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:57.521560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-ad8b3b68-3d10-4e06-b4c4-a6ff4a7c8073 admin admin] Security group rule updated ['5e680e58-21bf-4966-8fab-a680be3c9685'] Sep 04 01:04:57.525247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-ad8b3b68-3d10-4e06-b4c4-a6ff4a7c8073 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:04:57Z,description=,direction='ingress',ethertype='IPv6',id=6455b78c-0a42-486a-a941-68e3ffc1f276,normalized_cidr=None,port_range_max=,port_range_min=,project_id='cd838d15487d45ae99751bc557b4a742',protocol=,remote_address_group_id=,remote_group_id=5e680e58-21bf-4966-8fab-a680be3c9685,remote_ip_prefix=,revision_number=0,security_group_id=5e680e58-21bf-4966-8fab-a680be3c9685,updated_at=2022-09-04T01:04:57Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:04:57.525247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-ad8b3b68-3d10-4e06-b4c4-a6ff4a7c8073 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (6455b78c-0a42-486a-a941-68e3ffc1f276), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:57.525247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-ad8b3b68-3d10-4e06-b4c4-a6ff4a7c8073 admin admin] Security group rule updated ['5e680e58-21bf-4966-8fab-a680be3c9685'] Sep 04 01:04:57.525460 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-ad8b3b68-3d10-4e06-b4c4-a6ff4a7c8073 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:04:57Z,description=,direction='egress',ethertype='IPv4',id=d1985c68-c7d1-471b-91ea-08a3e16b869c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='cd838d15487d45ae99751bc557b4a742',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=5e680e58-21bf-4966-8fab-a680be3c9685,updated_at=2022-09-04T01:04:57Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:04:57.525460 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-ad8b3b68-3d10-4e06-b4c4-a6ff4a7c8073 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (d1985c68-c7d1-471b-91ea-08a3e16b869c), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:57.525460 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-ad8b3b68-3d10-4e06-b4c4-a6ff4a7c8073 admin admin] Security group rule updated ['5e680e58-21bf-4966-8fab-a680be3c9685'] Sep 04 01:04:57.529522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-ad8b3b68-3d10-4e06-b4c4-a6ff4a7c8073 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:04:57Z,description=,direction='ingress',ethertype='IPv4',id=ebb3096d-0d21-4d63-8396-944ced4c28f7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='cd838d15487d45ae99751bc557b4a742',protocol=,remote_address_group_id=,remote_group_id=5e680e58-21bf-4966-8fab-a680be3c9685,remote_ip_prefix=,revision_number=0,security_group_id=5e680e58-21bf-4966-8fab-a680be3c9685,updated_at=2022-09-04T01:04:57Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:04:57.530297 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-ad8b3b68-3d10-4e06-b4c4-a6ff4a7c8073 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (ebb3096d-0d21-4d63-8396-944ced4c28f7), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:57.530837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-ad8b3b68-3d10-4e06-b4c4-a6ff4a7c8073 admin admin] Security group rule updated ['5e680e58-21bf-4966-8fab-a680be3c9685'] Sep 04 01:04:57.610155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-94a0a9fc-a86b-4477-a695-dd58c4dd41f4 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(14beb63f-5d4e-4804-804c-c56824862acb)],cidr=172.20.0.0/28,created_at=2022-09-04T01:04:57Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=False,gateway_ip=172.20.0.1,host_routes=[],id=36ebda7b-6b63-4f93-9d3e-7042e3d41a8a,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-EncryptedVolumesExtendAttachedTest-487990549-subnet',network_id=bb66909c-9291-477a-9f2b-a9f4b56d351c,project_id='8cd5d05953314eaab3d768e33897858f',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-04T01:04:57Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:04:57.610727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-94a0a9fc-a86b-4477-a695-dd58c4dd41f4 admin admin] Publish callbacks [] for Subnet (36ebda7b-6b63-4f93-9d3e-7042e3d41a8a), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:57.669436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-40c60b75-9d51-401e-a910-04375cf10a38 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(e0ac35cb-ecca-43de-bae3-9f00077e8311)],cidr=172.20.0.0/28,created_at=2022-09-04T01:04:57Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=1af847f5-eeac-4b3d-afa5-aa099062676b,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-AttachVolumeNegativeTest-1875369034-subnet',network_id=d7f39628-666e-4480-8bee-49de183d5e09,project_id='287d111f08ac4b05bd5adec9c40d0620',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-04T01:04:57Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:04:57.669945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-40c60b75-9d51-401e-a910-04375cf10a38 admin admin] Publish callbacks [] for Subnet (1af847f5-eeac-4b3d-afa5-aa099062676b), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:57.774441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:250 started Sep 04 01:04:57.777685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade54bb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=169000000,duration_sec=507,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:04:57.778512 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:04:57.779045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:250 - starting polling. Elapsed:0.005 Sep 04 01:04:57.780589 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:57.782917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:250 - port information retrieved. Elapsed:0.009 Sep 04 01:04:57.783680 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Starting to process devices in:{'current': {'3fa24970-97a7-4f46-ac55-0b24323fa402', '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', '9b82da41-d694-43b0-a43b-5998addaf0bf', '89aa06b4-bbf1-40c2-bb48-500c3aecdf48', 'ca102ce7-433c-4029-aabf-33d944165ff1'}, 'added': set(), 'removed': set(), 'updated': {'9b82da41-d694-43b0-a43b-5998addaf0bf'}, 're_added': set()} {{(pid=107812) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 04 01:04:57.784456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': '9b82da41-d694-43b0-a43b-5998addaf0bf', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-3b7528ba-1624-4915-b635-aeb0700ea8e7', 'network_id': '3b7528ba-1624-4915-b635-aeb0700ea8e7', 'port_id': '9b82da41-d694-43b0-a43b-5998addaf0bf', 'mac_address': 'fa:16:3e:3b:22:50', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 158, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '46f76b48-bc1e-4bf9-b91c-49408437f259', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 01:04:57.790796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: 9b82da41-d694-43b0-a43b-5998addaf0bf {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:04:57.791229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 9b82da41-d694-43b0-a43b-5998addaf0bf updated. Details: {'device': '9b82da41-d694-43b0-a43b-5998addaf0bf', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-3b7528ba-1624-4915-b635-aeb0700ea8e7', 'network_id': '3b7528ba-1624-4915-b635-aeb0700ea8e7', 'port_id': '9b82da41-d694-43b0-a43b-5998addaf0bf', 'mac_address': 'fa:16:3e:3b:22:50', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 158, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '46f76b48-bc1e-4bf9-b91c-49408437f259', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 4} Sep 04 01:04:57.792411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap9b82da41-d6, col_values=(('tag', 4),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:04:57.795157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap9b82da41-d6, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:04:57.796258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap9b82da41-d6, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:04:57.796790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 01:04:57.798105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap9b82da41-d6, col_values=(('other_config', {'net_uuid': '3b7528ba-1624-4915-b635-aeb0700ea8e7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '158', 'tag': '4'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:04:57.798999 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 01:04:57.802929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade54bd,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 6}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:04:57.803589 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:250 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 5 devices currently available. Time elapsed: 0.019 Sep 04 01:04:57.804144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Refreshing firewall for 1 devices {{(pid=107812) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 04 01:04:57.804608 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Refresh firewall rules Sep 04 01:04:57.806224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information for ports dict_keys([]) {{(pid=107812) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 04 01:04:57.806769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information {{(pid=107812) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 04 01:04:57.810974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 2 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:04:57.875005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[53879a11-2a90-486c-9b20-b610e9720d43]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:04:57.877162 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:250 - agent port security group processed in 0.092 Sep 04 01:04:57.877937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for 9b82da41-d694-43b0-a43b-5998addaf0bf to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 01:04:58.441991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-40142c0a-4ef6-4a0a-8ce4-543db6192b65 admin admin] Resource SecurityGroup deleted: 5e680e58-21bf-4966-8fab-a680be3c9685 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:04:58.445734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-40142c0a-4ef6-4a0a-8ce4-543db6192b65 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (5e680e58-21bf-4966-8fab-a680be3c9685), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:58.446475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40142c0a-4ef6-4a0a-8ce4-543db6192b65 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('5e680e58-21bf-4966-8fab-a680be3c9685',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:04:58.628981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-dbdf3061-e5bb-4404-a69f-a521106817f2 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:04:57Z,description='Default security group',id=fbd5ce83-2674-4aae-8456-73943de6ac8f,is_default=True,name='default',project_id='959a493c8f8e49c990227d2229946a4f',revision_number=1,rules=[SecurityGroupRule(11dbf630-dd93-4ff9-89e7-17deeb587b81),SecurityGroupRule(6132ef6a-8ae2-477c-833e-755fd481cb5d),SecurityGroupRule(97e8491b-5106-4361-b483-069a0573c778),SecurityGroupRule(b4c043b0-bd1e-40a2-a3d6-3b556c529b5f)],shared=False,stateful=True,updated_at=2022-09-04T01:04:57Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:04:58.629675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-dbdf3061-e5bb-4404-a69f-a521106817f2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (fbd5ce83-2674-4aae-8456-73943de6ac8f), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:58.630926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-dbdf3061-e5bb-4404-a69f-a521106817f2 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:04:57Z,description=,direction='ingress',ethertype='IPv4',id=11dbf630-dd93-4ff9-89e7-17deeb587b81,normalized_cidr=None,port_range_max=,port_range_min=,project_id='959a493c8f8e49c990227d2229946a4f',protocol=,remote_address_group_id=,remote_group_id=fbd5ce83-2674-4aae-8456-73943de6ac8f,remote_ip_prefix=,revision_number=0,security_group_id=fbd5ce83-2674-4aae-8456-73943de6ac8f,updated_at=2022-09-04T01:04:57Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:04:58.631810 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-dbdf3061-e5bb-4404-a69f-a521106817f2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (11dbf630-dd93-4ff9-89e7-17deeb587b81), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:58.632770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-dbdf3061-e5bb-4404-a69f-a521106817f2 admin admin] Security group rule updated ['fbd5ce83-2674-4aae-8456-73943de6ac8f'] Sep 04 01:04:58.634188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-dbdf3061-e5bb-4404-a69f-a521106817f2 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:04:57Z,description=,direction='ingress',ethertype='IPv6',id=6132ef6a-8ae2-477c-833e-755fd481cb5d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='959a493c8f8e49c990227d2229946a4f',protocol=,remote_address_group_id=,remote_group_id=fbd5ce83-2674-4aae-8456-73943de6ac8f,remote_ip_prefix=,revision_number=0,security_group_id=fbd5ce83-2674-4aae-8456-73943de6ac8f,updated_at=2022-09-04T01:04:57Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:04:58.635261 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-dbdf3061-e5bb-4404-a69f-a521106817f2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (6132ef6a-8ae2-477c-833e-755fd481cb5d), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:58.638183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-dbdf3061-e5bb-4404-a69f-a521106817f2 admin admin] Security group rule updated ['fbd5ce83-2674-4aae-8456-73943de6ac8f'] Sep 04 01:04:58.639219 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-dbdf3061-e5bb-4404-a69f-a521106817f2 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:04:57Z,description=,direction='egress',ethertype='IPv6',id=97e8491b-5106-4361-b483-069a0573c778,normalized_cidr=None,port_range_max=,port_range_min=,project_id='959a493c8f8e49c990227d2229946a4f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=fbd5ce83-2674-4aae-8456-73943de6ac8f,updated_at=2022-09-04T01:04:57Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:04:58.641450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-dbdf3061-e5bb-4404-a69f-a521106817f2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (97e8491b-5106-4361-b483-069a0573c778), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:58.641450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-dbdf3061-e5bb-4404-a69f-a521106817f2 admin admin] Security group rule updated ['fbd5ce83-2674-4aae-8456-73943de6ac8f'] Sep 04 01:04:58.641450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-dbdf3061-e5bb-4404-a69f-a521106817f2 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:04:57Z,description=,direction='egress',ethertype='IPv4',id=b4c043b0-bd1e-40a2-a3d6-3b556c529b5f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='959a493c8f8e49c990227d2229946a4f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=fbd5ce83-2674-4aae-8456-73943de6ac8f,updated_at=2022-09-04T01:04:57Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:04:58.641450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-dbdf3061-e5bb-4404-a69f-a521106817f2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (b4c043b0-bd1e-40a2-a3d6-3b556c529b5f), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:58.644988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-dbdf3061-e5bb-4404-a69f-a521106817f2 admin admin] Security group rule updated ['fbd5ce83-2674-4aae-8456-73943de6ac8f'] Sep 04 01:04:58.751759 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-40142c0a-4ef6-4a0a-8ce4-543db6192b65 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('5e680e58-21bf-4966-8fab-a680be3c9685',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:04:58.752321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-40142c0a-4ef6-4a0a-8ce4-543db6192b65 admin admin] Resource SecurityGroupRule deleted: 33c5f7e6-304d-4749-a6db-9174541de430 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:04:58.752765 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-40142c0a-4ef6-4a0a-8ce4-543db6192b65 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (33c5f7e6-304d-4749-a6db-9174541de430), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:58.753749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-40142c0a-4ef6-4a0a-8ce4-543db6192b65 admin admin] Security group rule updated ['5e680e58-21bf-4966-8fab-a680be3c9685'] Sep 04 01:04:58.754278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-40142c0a-4ef6-4a0a-8ce4-543db6192b65 admin admin] Resource SecurityGroupRule deleted: 6455b78c-0a42-486a-a941-68e3ffc1f276 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:04:58.754839 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-40142c0a-4ef6-4a0a-8ce4-543db6192b65 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (6455b78c-0a42-486a-a941-68e3ffc1f276), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:58.755967 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-40142c0a-4ef6-4a0a-8ce4-543db6192b65 admin admin] Security group rule updated ['5e680e58-21bf-4966-8fab-a680be3c9685'] Sep 04 01:04:58.756705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-40142c0a-4ef6-4a0a-8ce4-543db6192b65 admin admin] Resource SecurityGroupRule deleted: d1985c68-c7d1-471b-91ea-08a3e16b869c {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:04:58.757183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-40142c0a-4ef6-4a0a-8ce4-543db6192b65 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (d1985c68-c7d1-471b-91ea-08a3e16b869c), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:58.757727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-40142c0a-4ef6-4a0a-8ce4-543db6192b65 admin admin] Security group rule updated ['5e680e58-21bf-4966-8fab-a680be3c9685'] Sep 04 01:04:58.758228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-40142c0a-4ef6-4a0a-8ce4-543db6192b65 admin admin] Resource SecurityGroupRule deleted: ebb3096d-0d21-4d63-8396-944ced4c28f7 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:04:58.758647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-40142c0a-4ef6-4a0a-8ce4-543db6192b65 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (ebb3096d-0d21-4d63-8396-944ced4c28f7), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:58.759042 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-40142c0a-4ef6-4a0a-8ce4-543db6192b65 admin admin] Security group rule updated ['5e680e58-21bf-4966-8fab-a680be3c9685'] Sep 04 01:04:59.041734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-16fa182d-23ae-454a-8fe1-f65e100144f0 admin admin] Resource SecurityGroup deleted: fbd5ce83-2674-4aae-8456-73943de6ac8f {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:04:59.042271 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-16fa182d-23ae-454a-8fe1-f65e100144f0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (fbd5ce83-2674-4aae-8456-73943de6ac8f), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:59.043090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16fa182d-23ae-454a-8fe1-f65e100144f0 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('fbd5ce83-2674-4aae-8456-73943de6ac8f',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:04:59.185273 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-16fa182d-23ae-454a-8fe1-f65e100144f0 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('fbd5ce83-2674-4aae-8456-73943de6ac8f',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:04:59.185798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-16fa182d-23ae-454a-8fe1-f65e100144f0 admin admin] Resource SecurityGroupRule deleted: 11dbf630-dd93-4ff9-89e7-17deeb587b81 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:04:59.186258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-16fa182d-23ae-454a-8fe1-f65e100144f0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (11dbf630-dd93-4ff9-89e7-17deeb587b81), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:59.186672 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-16fa182d-23ae-454a-8fe1-f65e100144f0 admin admin] Security group rule updated ['fbd5ce83-2674-4aae-8456-73943de6ac8f'] Sep 04 01:04:59.187789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-16fa182d-23ae-454a-8fe1-f65e100144f0 admin admin] Resource SecurityGroupRule deleted: 6132ef6a-8ae2-477c-833e-755fd481cb5d {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:04:59.188147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-16fa182d-23ae-454a-8fe1-f65e100144f0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (6132ef6a-8ae2-477c-833e-755fd481cb5d), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:59.188734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-16fa182d-23ae-454a-8fe1-f65e100144f0 admin admin] Security group rule updated ['fbd5ce83-2674-4aae-8456-73943de6ac8f'] Sep 04 01:04:59.189334 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-16fa182d-23ae-454a-8fe1-f65e100144f0 admin admin] Resource SecurityGroupRule deleted: 97e8491b-5106-4361-b483-069a0573c778 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:04:59.189869 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-16fa182d-23ae-454a-8fe1-f65e100144f0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (97e8491b-5106-4361-b483-069a0573c778), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:59.190818 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-16fa182d-23ae-454a-8fe1-f65e100144f0 admin admin] Security group rule updated ['fbd5ce83-2674-4aae-8456-73943de6ac8f'] Sep 04 01:04:59.197279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-16fa182d-23ae-454a-8fe1-f65e100144f0 admin admin] Resource SecurityGroupRule deleted: b4c043b0-bd1e-40a2-a3d6-3b556c529b5f {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:04:59.198138 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-16fa182d-23ae-454a-8fe1-f65e100144f0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (b4c043b0-bd1e-40a2-a3d6-3b556c529b5f), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:59.200967 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-16fa182d-23ae-454a-8fe1-f65e100144f0 admin admin] Security group rule updated ['fbd5ce83-2674-4aae-8456-73943de6ac8f'] Sep 04 01:04:59.482431 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-72c632f3-d7cb-48be-be47-2828c1a2d34f None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:04:57Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-3e702e6e-ebe1-46a7-b30d-f3d140ac2993',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=53e7a39c-e9ce-45c4-84af-632f2aac70ae,mac_address=fa:16:3e:f4:97:c5,name='',network_id=3e702e6e-ebe1-46a7-b30d-f3d140ac2993,numa_affinity_policy=,project_id='55faed42b7f243df9df879d581797f56',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(53e7a39c-e9ce-45c4-84af-632f2aac70ae),security_group_ids=set([]),status='DOWN',updated_at=2022-09-04T01:04:58Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:04:59.483040 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-72c632f3-d7cb-48be-be47-2828c1a2d34f None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (53e7a39c-e9ce-45c4-84af-632f2aac70ae), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:59.608466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-fae32d4e-8f19-4890-95d6-369ed0e7eef0 None None] Resource Port 3c278ab2-dc61-40f8-ab29-c8cc8b740d7d updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=3c278ab2-dc61-40f8-ab29-c8cc8b740d7d,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=3c278ab2-dc61-40f8-ab29-c8cc8b740d7d,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:04:59.608872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-fae32d4e-8f19-4890-95d6-369ed0e7eef0 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (3c278ab2-dc61-40f8-ab29-c8cc8b740d7d), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:59.617879 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-cbac1910-b2e5-4142-b88b-86c2161ea201 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:04:59Z,description='Default security group',id=4e4e4233-80fe-4d21-99ad-240f9f04a1e7,is_default=True,name='default',project_id='ee5bd28fea9e4ab49b23f0ececbe3e26',revision_number=1,rules=[SecurityGroupRule(061db34c-3508-4193-93da-dc34f480ad0b),SecurityGroupRule(3bd4ec6a-f963-49fb-a5e4-14d10dc7d493),SecurityGroupRule(c8283cdc-b0bb-41a1-a29b-41d96269d4e1),SecurityGroupRule(ea3e9e9a-9073-480c-87f3-52cb1b32144e)],shared=False,stateful=True,updated_at=2022-09-04T01:04:59Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:04:59.618386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-cbac1910-b2e5-4142-b88b-86c2161ea201 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (4e4e4233-80fe-4d21-99ad-240f9f04a1e7), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:59.619174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-cbac1910-b2e5-4142-b88b-86c2161ea201 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:04:59Z,description=,direction='ingress',ethertype='IPv6',id=061db34c-3508-4193-93da-dc34f480ad0b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ee5bd28fea9e4ab49b23f0ececbe3e26',protocol=,remote_address_group_id=,remote_group_id=4e4e4233-80fe-4d21-99ad-240f9f04a1e7,remote_ip_prefix=,revision_number=0,security_group_id=4e4e4233-80fe-4d21-99ad-240f9f04a1e7,updated_at=2022-09-04T01:04:59Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:04:59.619614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-cbac1910-b2e5-4142-b88b-86c2161ea201 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (061db34c-3508-4193-93da-dc34f480ad0b), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:59.622453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-cbac1910-b2e5-4142-b88b-86c2161ea201 admin admin] Security group rule updated ['4e4e4233-80fe-4d21-99ad-240f9f04a1e7'] Sep 04 01:04:59.623881 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-cbac1910-b2e5-4142-b88b-86c2161ea201 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:04:59Z,description=,direction='egress',ethertype='IPv4',id=3bd4ec6a-f963-49fb-a5e4-14d10dc7d493,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ee5bd28fea9e4ab49b23f0ececbe3e26',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=4e4e4233-80fe-4d21-99ad-240f9f04a1e7,updated_at=2022-09-04T01:04:59Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:04:59.624567 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-cbac1910-b2e5-4142-b88b-86c2161ea201 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (3bd4ec6a-f963-49fb-a5e4-14d10dc7d493), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:59.624986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-cbac1910-b2e5-4142-b88b-86c2161ea201 admin admin] Security group rule updated ['4e4e4233-80fe-4d21-99ad-240f9f04a1e7'] Sep 04 01:04:59.626678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-cbac1910-b2e5-4142-b88b-86c2161ea201 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:04:59Z,description=,direction='ingress',ethertype='IPv4',id=c8283cdc-b0bb-41a1-a29b-41d96269d4e1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ee5bd28fea9e4ab49b23f0ececbe3e26',protocol=,remote_address_group_id=,remote_group_id=4e4e4233-80fe-4d21-99ad-240f9f04a1e7,remote_ip_prefix=,revision_number=0,security_group_id=4e4e4233-80fe-4d21-99ad-240f9f04a1e7,updated_at=2022-09-04T01:04:59Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:04:59.626678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-cbac1910-b2e5-4142-b88b-86c2161ea201 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (c8283cdc-b0bb-41a1-a29b-41d96269d4e1), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:59.626854 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-cbac1910-b2e5-4142-b88b-86c2161ea201 admin admin] Security group rule updated ['4e4e4233-80fe-4d21-99ad-240f9f04a1e7'] Sep 04 01:04:59.628264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-cbac1910-b2e5-4142-b88b-86c2161ea201 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:04:59Z,description=,direction='egress',ethertype='IPv6',id=ea3e9e9a-9073-480c-87f3-52cb1b32144e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ee5bd28fea9e4ab49b23f0ececbe3e26',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=4e4e4233-80fe-4d21-99ad-240f9f04a1e7,updated_at=2022-09-04T01:04:59Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:04:59.628816 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-cbac1910-b2e5-4142-b88b-86c2161ea201 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (ea3e9e9a-9073-480c-87f3-52cb1b32144e), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:59.629359 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-cbac1910-b2e5-4142-b88b-86c2161ea201 admin admin] Security group rule updated ['4e4e4233-80fe-4d21-99ad-240f9f04a1e7'] Sep 04 01:04:59.721831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Configuration for devices up ['9b82da41-d694-43b0-a43b-5998addaf0bf'] and devices down [] completed. Sep 04 01:04:59.722149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:250 - ports processed. Elapsed:1.948 Sep 04 01:04:59.722694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:250 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:1.949 Sep 04 01:04:59.775338 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:251 started Sep 04 01:04:59.778487 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade54bf,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=170000000,duration_sec=509,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:04:59.779243 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:04:59.779822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:251 - starting polling. Elapsed:0.005 Sep 04 01:04:59.781438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:04:59.783195 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:251 - port information retrieved. Elapsed:0.008 Sep 04 01:04:59.783772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:251 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 04 01:04:59.909291 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-fae32d4e-8f19-4890-95d6-369ed0e7eef0 None None] Resource Port 3c278ab2-dc61-40f8-ab29-c8cc8b740d7d updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=3c278ab2-dc61-40f8-ab29-c8cc8b740d7d,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=3c278ab2-dc61-40f8-ab29-c8cc8b740d7d,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=3c278ab2-dc61-40f8-ab29-c8cc8b740d7d,segment=NetworkSegment(c26850af-ca47-4ea8-9a33-a34f3381800e),segment_id=c26850af-ca47-4ea8-9a33-a34f3381800e)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:04:59.911267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-fae32d4e-8f19-4890-95d6-369ed0e7eef0 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (3c278ab2-dc61-40f8-ab29-c8cc8b740d7d), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:00.002536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-bdc368d2-db0e-4bc8-b743-652425463eca admin admin] Resource SecurityGroup deleted: 4e4e4233-80fe-4d21-99ad-240f9f04a1e7 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:00.003181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-bdc368d2-db0e-4bc8-b743-652425463eca admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (4e4e4233-80fe-4d21-99ad-240f9f04a1e7), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:00.003832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bdc368d2-db0e-4bc8-b743-652425463eca admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('4e4e4233-80fe-4d21-99ad-240f9f04a1e7',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:05:00.164687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-bdc368d2-db0e-4bc8-b743-652425463eca admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('4e4e4233-80fe-4d21-99ad-240f9f04a1e7',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:05:00.164687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-bdc368d2-db0e-4bc8-b743-652425463eca admin admin] Resource SecurityGroupRule deleted: 061db34c-3508-4193-93da-dc34f480ad0b {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:00.164687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-bdc368d2-db0e-4bc8-b743-652425463eca admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (061db34c-3508-4193-93da-dc34f480ad0b), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:00.165045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-bdc368d2-db0e-4bc8-b743-652425463eca admin admin] Security group rule updated ['4e4e4233-80fe-4d21-99ad-240f9f04a1e7'] Sep 04 01:05:00.166268 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-bdc368d2-db0e-4bc8-b743-652425463eca admin admin] Resource SecurityGroupRule deleted: 3bd4ec6a-f963-49fb-a5e4-14d10dc7d493 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:00.166629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-bdc368d2-db0e-4bc8-b743-652425463eca admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (3bd4ec6a-f963-49fb-a5e4-14d10dc7d493), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:00.171772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-bdc368d2-db0e-4bc8-b743-652425463eca admin admin] Security group rule updated ['4e4e4233-80fe-4d21-99ad-240f9f04a1e7'] Sep 04 01:05:00.171772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-bdc368d2-db0e-4bc8-b743-652425463eca admin admin] Resource SecurityGroupRule deleted: c8283cdc-b0bb-41a1-a29b-41d96269d4e1 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:00.171772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-bdc368d2-db0e-4bc8-b743-652425463eca admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (c8283cdc-b0bb-41a1-a29b-41d96269d4e1), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:00.171772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-bdc368d2-db0e-4bc8-b743-652425463eca admin admin] Security group rule updated ['4e4e4233-80fe-4d21-99ad-240f9f04a1e7'] Sep 04 01:05:00.171772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-bdc368d2-db0e-4bc8-b743-652425463eca admin admin] Resource SecurityGroupRule deleted: ea3e9e9a-9073-480c-87f3-52cb1b32144e {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:00.172190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-bdc368d2-db0e-4bc8-b743-652425463eca admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (ea3e9e9a-9073-480c-87f3-52cb1b32144e), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:00.172190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-bdc368d2-db0e-4bc8-b743-652425463eca admin admin] Security group rule updated ['4e4e4233-80fe-4d21-99ad-240f9f04a1e7'] Sep 04 01:05:00.571463 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-3ef30ee4-4753-4a53-9ebf-2cb4aaa4fbde admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:05:00Z,description='Default security group',id=8f0bcf6f-cf3f-4eea-8ce8-5f46f2c8f075,is_default=True,name='default',project_id='d19b79b17abb4d78a4cc302a316f3688',revision_number=1,rules=[SecurityGroupRule(15633227-d474-48e2-ad05-506e851efa16),SecurityGroupRule(1ef89f9e-ee54-43e2-b995-c681e03917ef),SecurityGroupRule(319d97a7-aad0-46af-b309-25b5a263ef40),SecurityGroupRule(3dbc66b5-23e0-4edc-a054-94ac38222dd4)],shared=False,stateful=True,updated_at=2022-09-04T01:05:00Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:00.585060 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-3ef30ee4-4753-4a53-9ebf-2cb4aaa4fbde admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (8f0bcf6f-cf3f-4eea-8ce8-5f46f2c8f075), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:00.585060 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-3ef30ee4-4753-4a53-9ebf-2cb4aaa4fbde admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:05:00Z,description=,direction='ingress',ethertype='IPv4',id=15633227-d474-48e2-ad05-506e851efa16,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d19b79b17abb4d78a4cc302a316f3688',protocol=,remote_address_group_id=,remote_group_id=8f0bcf6f-cf3f-4eea-8ce8-5f46f2c8f075,remote_ip_prefix=,revision_number=0,security_group_id=8f0bcf6f-cf3f-4eea-8ce8-5f46f2c8f075,updated_at=2022-09-04T01:05:00Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:00.585060 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-3ef30ee4-4753-4a53-9ebf-2cb4aaa4fbde admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (15633227-d474-48e2-ad05-506e851efa16), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:00.585060 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-3ef30ee4-4753-4a53-9ebf-2cb4aaa4fbde admin admin] Security group rule updated ['8f0bcf6f-cf3f-4eea-8ce8-5f46f2c8f075'] Sep 04 01:05:00.585437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-3ef30ee4-4753-4a53-9ebf-2cb4aaa4fbde admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:05:00Z,description=,direction='egress',ethertype='IPv6',id=1ef89f9e-ee54-43e2-b995-c681e03917ef,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d19b79b17abb4d78a4cc302a316f3688',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=8f0bcf6f-cf3f-4eea-8ce8-5f46f2c8f075,updated_at=2022-09-04T01:05:00Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:00.585437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-3ef30ee4-4753-4a53-9ebf-2cb4aaa4fbde admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (1ef89f9e-ee54-43e2-b995-c681e03917ef), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:00.585437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-3ef30ee4-4753-4a53-9ebf-2cb4aaa4fbde admin admin] Security group rule updated ['8f0bcf6f-cf3f-4eea-8ce8-5f46f2c8f075'] Sep 04 01:05:00.585613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-3ef30ee4-4753-4a53-9ebf-2cb4aaa4fbde admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:05:00Z,description=,direction='egress',ethertype='IPv4',id=319d97a7-aad0-46af-b309-25b5a263ef40,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d19b79b17abb4d78a4cc302a316f3688',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=8f0bcf6f-cf3f-4eea-8ce8-5f46f2c8f075,updated_at=2022-09-04T01:05:00Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:00.585613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-3ef30ee4-4753-4a53-9ebf-2cb4aaa4fbde admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (319d97a7-aad0-46af-b309-25b5a263ef40), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:00.585613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-3ef30ee4-4753-4a53-9ebf-2cb4aaa4fbde admin admin] Security group rule updated ['8f0bcf6f-cf3f-4eea-8ce8-5f46f2c8f075'] Sep 04 01:05:00.585790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-3ef30ee4-4753-4a53-9ebf-2cb4aaa4fbde admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:05:00Z,description=,direction='ingress',ethertype='IPv6',id=3dbc66b5-23e0-4edc-a054-94ac38222dd4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d19b79b17abb4d78a4cc302a316f3688',protocol=,remote_address_group_id=,remote_group_id=8f0bcf6f-cf3f-4eea-8ce8-5f46f2c8f075,remote_ip_prefix=,revision_number=0,security_group_id=8f0bcf6f-cf3f-4eea-8ce8-5f46f2c8f075,updated_at=2022-09-04T01:05:00Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:00.585790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-3ef30ee4-4753-4a53-9ebf-2cb4aaa4fbde admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (3dbc66b5-23e0-4edc-a054-94ac38222dd4), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:00.585790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-3ef30ee4-4753-4a53-9ebf-2cb4aaa4fbde admin admin] Security group rule updated ['8f0bcf6f-cf3f-4eea-8ce8-5f46f2c8f075'] Sep 04 01:05:00.694293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["3ea6bfd3-f140-4cd5-89e2-21ab81396b7c","insert","tap53e7a39c-e9",["set",[]],["map",[["attached-mac","fa:16:3e:f4:97:c5"],["iface-id","53e7a39c-e9ce-45c4-84af-632f2aac70ae"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:05:00.718970 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["3ea6bfd3-f140-4cd5-89e2-21ab81396b7c","old",null,["set",[]],null],["","new","tap53e7a39c-e9",7,["map",[["attached-mac","fa:16:3e:f4:97:c5"],["iface-id","53e7a39c-e9ce-45c4-84af-632f2aac70ae"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:05:00.842615 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-72c632f3-d7cb-48be-be47-2828c1a2d34f None None] Resource Port 53e7a39c-e9ce-45c4-84af-632f2aac70ae updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=53e7a39c-e9ce-45c4-84af-632f2aac70ae,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=53e7a39c-e9ce-45c4-84af-632f2aac70ae,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=53e7a39c-e9ce-45c4-84af-632f2aac70ae,segment=NetworkSegment(294bd754-f77e-4dd5-a8a8-fa66c41ba024),segment_id=294bd754-f77e-4dd5-a8a8-fa66c41ba024)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:05:00.843101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-72c632f3-d7cb-48be-be47-2828c1a2d34f None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (53e7a39c-e9ce-45c4-84af-632f2aac70ae), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:00.913963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["925a7810-ba2c-4bdf-b62c-4d19a454d6cd","insert","qg-3c278ab2-dc",["set",[]],["map",[["attached-mac","fa:16:3e:92:fb:aa"],["iface-id","3c278ab2-dc61-40f8-ab29-c8cc8b740d7d"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:05:00.957406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["925a7810-ba2c-4bdf-b62c-4d19a454d6cd","old",null,["set",[]],null],["","new","qg-3c278ab2-dc",8,["map",[["attached-mac","fa:16:3e:92:fb:aa"],["iface-id","3c278ab2-dc61-40f8-ab29-c8cc8b740d7d"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:05:00.980760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-fb2e2dbd-2266-4a9d-8fde-cd26a82b6950 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:04:59Z,data_plane_status=None,description='',device_id='e4262b22-bfcc-4362-b0da-5c283cfb2e9a',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=1cf499fb-10a0-4af2-afec-5f610dc85da6,mac_address=fa:16:3e:8a:3e:25,name='',network_id=e8e0564a-d5c9-4fe0-b2d4-538f45096708,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(1cf499fb-10a0-4af2-afec-5f610dc85da6),security_group_ids=set([]),status='DOWN',updated_at=2022-09-04T01:04:59Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:00.981400 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-fb2e2dbd-2266-4a9d-8fde-cd26a82b6950 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (1cf499fb-10a0-4af2-afec-5f610dc85da6), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:01.085833 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-3ef30ee4-4753-4a53-9ebf-2cb4aaa4fbde admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-04T01:05:00Z,description='',dns_domain=None,id=24c98e7f-be01-4588-b989-3d3624ceef7c,mtu=1500,name='tempest-EncryptedVolumesExtendAttachedTest-763805907-network',project_id='d19b79b17abb4d78a4cc302a316f3688',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(24c98e7f-be01-4588-b989-3d3624ceef7c),segments=[NetworkSegment(492f51d8-b693-47c8-b61c-a48c0bcabb44)],shared=False,status='ACTIVE',updated_at=2022-09-04T01:05:00Z,vlan_transparent=) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:01.087075 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-3ef30ee4-4753-4a53-9ebf-2cb4aaa4fbde admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533'] for Network (24c98e7f-be01-4588-b989-3d3624ceef7c), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:01.343205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager [None req-3ef30ee4-4753-4a53-9ebf-2cb4aaa4fbde admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 24c98e7f-be01-4588-b989-3d3624ceef7c with segmentation id not found. Sep 04 01:05:01.343205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 04 01:05:01.343205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 04 01:05:01.343205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 04 01:05:01.343205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 04 01:05:01.343205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 04 01:05:01.343205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 04 01:05:01.343205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 04 01:05:01.343205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 04 01:05:01.343205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 04 01:05:01.343205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 04 01:05:01.343205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 04 01:05:01.343205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 04 01:05:01.343954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 04 01:05:01.343954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 04 01:05:01.343954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 04 01:05:01.343954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 24c98e7f-be01-4588-b989-3d3624ceef7c with segmentation id not found. Sep 04 01:05:01.343954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager Sep 04 01:05:01.497901 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0cdac2e2-b0c9-4bef-a005-179106ca850d None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:04:58Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-b16f22e1-6fb1-440b-98eb-845123e960e6',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=f45b435f-0f64-41fe-a6ec-36683da765f9,mac_address=fa:16:3e:eb:c4:7f,name='',network_id=b16f22e1-6fb1-440b-98eb-845123e960e6,numa_affinity_policy=,project_id='db72b63281384bd883b04d05bcc35677',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(f45b435f-0f64-41fe-a6ec-36683da765f9),security_group_ids=set([]),status='DOWN',updated_at=2022-09-04T01:05:00Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:01.499405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-0cdac2e2-b0c9-4bef-a005-179106ca850d None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (f45b435f-0f64-41fe-a6ec-36683da765f9), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:01.662165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4c1d6d9d-4520-4f62-ac80-37e5ab604b1d None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:04:57Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-1fb5aed8-696d-4f87-8b2a-7d29744538a8',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=dd44c60a-dd0f-4ff2-85ae-8c012af89cf9,mac_address=fa:16:3e:6f:ff:ef,name='',network_id=1fb5aed8-696d-4f87-8b2a-7d29744538a8,numa_affinity_policy=,project_id='e7dca68418a14d7da9aa63ac25f202e8',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(dd44c60a-dd0f-4ff2-85ae-8c012af89cf9),security_group_ids=set([]),status='DOWN',updated_at=2022-09-04T01:05:00Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:01.662651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4c1d6d9d-4520-4f62-ac80-37e5ab604b1d None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (dd44c60a-dd0f-4ff2-85ae-8c012af89cf9), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:01.777699 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:252 started Sep 04 01:05:01.781551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade54c1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=172000000,duration_sec=511,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:05:01.782351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:05:01.783091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:252 - starting polling. Elapsed:0.006 Sep 04 01:05:01.785092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:01.789182 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:252 - port information retrieved. Elapsed:0.012 Sep 04 01:05:01.789697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Starting to process devices in:{'current': {'3fa24970-97a7-4f46-ac55-0b24323fa402', '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', '9b82da41-d694-43b0-a43b-5998addaf0bf', '3c278ab2-dc61-40f8-ab29-c8cc8b740d7d', '89aa06b4-bbf1-40c2-bb48-500c3aecdf48', '53e7a39c-e9ce-45c4-84af-632f2aac70ae', 'ca102ce7-433c-4029-aabf-33d944165ff1'}, 'added': {'3c278ab2-dc61-40f8-ab29-c8cc8b740d7d', '53e7a39c-e9ce-45c4-84af-632f2aac70ae'}, 'removed': set(), 'updated': {'3c278ab2-dc61-40f8-ab29-c8cc8b740d7d', '53e7a39c-e9ce-45c4-84af-632f2aac70ae'}, 're_added': set()} {{(pid=107812) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 04 01:05:01.793408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': '3c278ab2-dc61-40f8-ab29-c8cc8b740d7d', 'device_id': 'a8e13541-9272-4fa2-a9ff-940907d6ba01', 'network_id': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'port_id': '3c278ab2-dc61-40f8-ab29-c8cc8b740d7d', 'mac_address': 'fa:16:3e:92:fb:aa', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '2b17f894-c374-4207-90ad-14f794c86627', 'ip_address': '172.37.7.191'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 01:05:01.794157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': '53e7a39c-e9ce-45c4-84af-632f2aac70ae', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-3e702e6e-ebe1-46a7-b30d-f3d140ac2993', 'network_id': '3e702e6e-ebe1-46a7-b30d-f3d140ac2993', 'port_id': '53e7a39c-e9ce-45c4-84af-632f2aac70ae', 'mac_address': 'fa:16:3e:f4:97:c5', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 167, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'b8f8e824-5e09-4bb6-bfba-faf43aae1f44', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 01:05:01.798676 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: 3c278ab2-dc61-40f8-ab29-c8cc8b740d7d {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:05:01.799273 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 3c278ab2-dc61-40f8-ab29-c8cc8b740d7d updated. Details: {'device': '3c278ab2-dc61-40f8-ab29-c8cc8b740d7d', 'device_id': 'a8e13541-9272-4fa2-a9ff-940907d6ba01', 'network_id': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'port_id': '3c278ab2-dc61-40f8-ab29-c8cc8b740d7d', 'mac_address': 'fa:16:3e:92:fb:aa', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '2b17f894-c374-4207-90ad-14f794c86627', 'ip_address': '172.37.7.191'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 04 01:05:01.802387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-3c278ab2-dc, col_values=(('tag', 2),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:01.803119 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-3c278ab2-dc, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:01.804133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-3c278ab2-dc, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:01.817456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-3c278ab2-dc, col_values=(('other_config', {'net_uuid': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:01.834474 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade54c3,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 8}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:05:01.837944 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: 53e7a39c-e9ce-45c4-84af-632f2aac70ae {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:05:01.838536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 53e7a39c-e9ce-45c4-84af-632f2aac70ae updated. Details: {'device': '53e7a39c-e9ce-45c4-84af-632f2aac70ae', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-3e702e6e-ebe1-46a7-b30d-f3d140ac2993', 'network_id': '3e702e6e-ebe1-46a7-b30d-f3d140ac2993', 'port_id': '53e7a39c-e9ce-45c4-84af-632f2aac70ae', 'mac_address': 'fa:16:3e:f4:97:c5', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 167, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'b8f8e824-5e09-4bb6-bfba-faf43aae1f44', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Sep 04 01:05:01.839039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Assigning 5 as local vlan for net-id=3e702e6e-ebe1-46a7-b30d-f3d140ac2993, seg-id=167 Sep 04 01:05:01.844167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0x1fd38bf5,OFPFlowMod(buffer_id=4294967295,command=0,cookie=6561907047025962751,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4263), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4101}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:05:01.853560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0xeade54c5,OFPFlowMod(buffer_id=4294967295,command=0,cookie=6887031442322345889,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4101)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4263}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:05:01.856574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap53e7a39c-e9, col_values=(('tag', 5),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:01.858587 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap53e7a39c-e9, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:01.859172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap53e7a39c-e9, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:01.874117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap53e7a39c-e9, col_values=(('other_config', {'net_uuid': '3e702e6e-ebe1-46a7-b30d-f3d140ac2993', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '5', 'segmentation_id': '167'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:01.905560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade54c7,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 7}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:05:01.906219 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:252 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 7 devices currently available. Time elapsed: 0.116 Sep 04 01:05:01.907967 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Preparing device filters for 2 new devices {{(pid=107812) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 04 01:05:01.909251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Preparing filters for devices {'3c278ab2-dc61-40f8-ab29-c8cc8b740d7d', '53e7a39c-e9ce-45c4-84af-632f2aac70ae'} Sep 04 01:05:01.918017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information for ports dict_keys([]) {{(pid=107812) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 04 01:05:01.918017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information {{(pid=107812) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 04 01:05:01.941532 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-724eea74-9eff-403e-a556-663ab372b134 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:04:59Z,data_plane_status=None,description='',device_id='d7fde424-29f8-4dba-95d8-51709b034af5',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=3045b911-01c5-4fc3-8e89-ac2d9cea12a8,mac_address=fa:16:3e:f1:55:69,name='',network_id=e8e0564a-d5c9-4fe0-b2d4-538f45096708,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(3045b911-01c5-4fc3-8e89-ac2d9cea12a8),security_group_ids=set([]),status='DOWN',updated_at=2022-09-04T01:05:00Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:01.948326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-724eea74-9eff-403e-a556-663ab372b134 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (3045b911-01c5-4fc3-8e89-ac2d9cea12a8), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:01.950217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 4 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:05:01.997126 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-79e93433-5f4e-43b2-a8f0-09352d58d0c7 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:05:00Z,data_plane_status=None,description='',device_id='a8e13541-9272-4fa2-a9ff-940907d6ba01',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=a62a40a2-96f5-427a-808e-9e63c8644245,mac_address=fa:16:3e:dd:cb:78,name='',network_id=3b7528ba-1624-4915-b635-aeb0700ea8e7,numa_affinity_policy=,project_id='e07d8b14fef34e04a0410f12e5dbd2fe',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(a62a40a2-96f5-427a-808e-9e63c8644245),security_group_ids=set([]),status='DOWN',updated_at=2022-09-04T01:05:00Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:01.997693 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-79e93433-5f4e-43b2-a8f0-09352d58d0c7 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (a62a40a2-96f5-427a-808e-9e63c8644245), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:02.071481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[66cfa07f-6308-420b-bccb-a8a2e93c4c46]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:05:02.071631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:252 - agent port security group processed in 0.281 Sep 04 01:05:02.072264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for 3c278ab2-dc61-40f8-ab29-c8cc8b740d7d to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 01:05:02.072588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for 53e7a39c-e9ce-45c4-84af-632f2aac70ae to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 01:05:02.103842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-2c4c8b4a-d086-4b0f-94d4-0ccc4ac8b9f8 None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:04:58Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-d7f39628-666e-4480-8bee-49de183d5e09',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=0a1a9f7e-73de-4620-ae03-4b1d50d7f706,mac_address=fa:16:3e:d1:46:c7,name='',network_id=d7f39628-666e-4480-8bee-49de183d5e09,numa_affinity_policy=,project_id='287d111f08ac4b05bd5adec9c40d0620',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(0a1a9f7e-73de-4620-ae03-4b1d50d7f706),security_group_ids=set([]),status='DOWN',updated_at=2022-09-04T01:05:00Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:02.103842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-2c4c8b4a-d086-4b0f-94d4-0ccc4ac8b9f8 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (0a1a9f7e-73de-4620-ae03-4b1d50d7f706), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:02.281196 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["e654db50-2184-4ae5-84eb-fd002a965d61","insert","tapdd44c60a-dd",["set",[]],["map",[["attached-mac","fa:16:3e:6f:ff:ef"],["iface-id","dd44c60a-dd0f-4ff2-85ae-8c012af89cf9"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:05:02.302511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["e654db50-2184-4ae5-84eb-fd002a965d61","old",null,["set",[]],null],["","new","tapdd44c60a-dd",9,["map",[["attached-mac","fa:16:3e:6f:ff:ef"],["iface-id","dd44c60a-dd0f-4ff2-85ae-8c012af89cf9"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:05:02.322966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c9a8d754-f335-4e99-8fd8-fd23fdf67750 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(3f549940-a338-41fe-8d7c-e2dd58ff0dac)],cidr=172.20.0.0/28,created_at=2022-09-04T01:05:01Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=False,gateway_ip=172.20.0.1,host_routes=[],id=14ddfef7-ea16-41a8-8988-1fdad0c9c4f9,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-EncryptedVolumesExtendAttachedTest-763805907-subnet',network_id=24c98e7f-be01-4588-b989-3d3624ceef7c,project_id='d19b79b17abb4d78a4cc302a316f3688',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-04T01:05:01Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:02.323913 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-c9a8d754-f335-4e99-8fd8-fd23fdf67750 admin admin] Publish callbacks [] for Subnet (14ddfef7-ea16-41a8-8988-1fdad0c9c4f9), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:02.709490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4c1d6d9d-4520-4f62-ac80-37e5ab604b1d None None] Resource Port dd44c60a-dd0f-4ff2-85ae-8c012af89cf9 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=dd44c60a-dd0f-4ff2-85ae-8c012af89cf9,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=dd44c60a-dd0f-4ff2-85ae-8c012af89cf9,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=dd44c60a-dd0f-4ff2-85ae-8c012af89cf9,segment=NetworkSegment(79b84dcb-99f6-4af2-ac73-30fcaae597f6),segment_id=79b84dcb-99f6-4af2-ac73-30fcaae597f6)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:05:02.710181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4c1d6d9d-4520-4f62-ac80-37e5ab604b1d None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (dd44c60a-dd0f-4ff2-85ae-8c012af89cf9), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:02.717600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["295bb9a1-b5f4-42bc-9182-173c2ecd96db","insert","tapf45b435f-0f",["set",[]],["map",[["attached-mac","fa:16:3e:eb:c4:7f"],["iface-id","f45b435f-0f64-41fe-a6ec-36683da765f9"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:05:02.742818 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["295bb9a1-b5f4-42bc-9182-173c2ecd96db","old",null,["set",[]],null],["","new","tapf45b435f-0f",10,["map",[["attached-mac","fa:16:3e:eb:c4:7f"],["iface-id","f45b435f-0f64-41fe-a6ec-36683da765f9"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:05:03.152828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["c7b46d5b-c0b8-4b90-a881-ad88b2523daf","insert","tap0a1a9f7e-73",["set",[]],["map",[["attached-mac","fa:16:3e:d1:46:c7"],["iface-id","0a1a9f7e-73de-4620-ae03-4b1d50d7f706"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:05:03.180940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["c7b46d5b-c0b8-4b90-a881-ad88b2523daf","old",null,["set",[]],null],["","new","tap0a1a9f7e-73",11,["map",[["attached-mac","fa:16:3e:d1:46:c7"],["iface-id","0a1a9f7e-73de-4620-ae03-4b1d50d7f706"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:05:03.421745 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4cc1139d-3a56-4b90-bba6-fb7dc1a0176c admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:05:00Z,data_plane_status=None,description='',device_id='a6875d57-1898-4fcc-8186-5995078e83c1',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=4ed942cd-0f45-4d77-a66d-1d6c875877dc,mac_address=fa:16:3e:0e:53:5a,name='',network_id=e8e0564a-d5c9-4fe0-b2d4-538f45096708,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(4ed942cd-0f45-4d77-a66d-1d6c875877dc),security_group_ids=set([]),status='DOWN',updated_at=2022-09-04T01:05:01Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:03.422502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4cc1139d-3a56-4b90-bba6-fb7dc1a0176c admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (4ed942cd-0f45-4d77-a66d-1d6c875877dc), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:03.539478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0cdac2e2-b0c9-4bef-a005-179106ca850d None None] Resource Port f45b435f-0f64-41fe-a6ec-36683da765f9 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=f45b435f-0f64-41fe-a6ec-36683da765f9,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=f45b435f-0f64-41fe-a6ec-36683da765f9,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=f45b435f-0f64-41fe-a6ec-36683da765f9,segment=NetworkSegment(c1d2cfbc-d3d5-4bd8-9da5-bc22dc7bb131),segment_id=c1d2cfbc-d3d5-4bd8-9da5-bc22dc7bb131)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:05:03.540284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-0cdac2e2-b0c9-4bef-a005-179106ca850d None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (f45b435f-0f64-41fe-a6ec-36683da765f9), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:03.751813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-2c4c8b4a-d086-4b0f-94d4-0ccc4ac8b9f8 None None] Resource Port 0a1a9f7e-73de-4620-ae03-4b1d50d7f706 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=0a1a9f7e-73de-4620-ae03-4b1d50d7f706,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=0a1a9f7e-73de-4620-ae03-4b1d50d7f706,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=0a1a9f7e-73de-4620-ae03-4b1d50d7f706,segment=NetworkSegment(929a573e-75ef-46ab-9889-4a31869bd81c),segment_id=929a573e-75ef-46ab-9889-4a31869bd81c)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:05:03.752201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-2c4c8b4a-d086-4b0f-94d4-0ccc4ac8b9f8 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (0a1a9f7e-73de-4620-ae03-4b1d50d7f706), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:04.124251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-aca21bda-a306-49eb-974f-f517f880bb83 None None] Resource Port 53e7a39c-e9ce-45c4-84af-632f2aac70ae updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:05:04.124636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-aca21bda-a306-49eb-974f-f517f880bb83 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (53e7a39c-e9ce-45c4-84af-632f2aac70ae), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:04.450476 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-d8434f1e-2b23-4cf2-9ded-64e90897291d admin admin] Resource Subnet deleted: 36ebda7b-6b63-4f93-9d3e-7042e3d41a8a {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:04.451083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-d8434f1e-2b23-4cf2-9ded-64e90897291d admin admin] Publish callbacks [] for Subnet (36ebda7b-6b63-4f93-9d3e-7042e3d41a8a), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:04.704297 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Resource Port 3c278ab2-dc61-40f8-ab29-c8cc8b740d7d updated (revision_number 3->4). Old fields: {'status': 'DOWN', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=3c278ab2-dc61-40f8-ab29-c8cc8b740d7d,segment=NetworkSegment(c26850af-ca47-4ea8-9a33-a34f3381800e),segment_id=c26850af-ca47-4ea8-9a33-a34f3381800e)]} New fields: {'status': 'ACTIVE', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=3c278ab2-dc61-40f8-ab29-c8cc8b740d7d,segment=NetworkSegment(c26850af-ca47-4ea8-9a33-a34f3381800e),segment_id=c26850af-ca47-4ea8-9a33-a34f3381800e)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:05:04.704897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (3c278ab2-dc61-40f8-ab29-c8cc8b740d7d), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:04.915666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c68acbef-90c9-445c-8fc8-ae574498ff8d admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:05:00Z,data_plane_status=None,description='',device_id='61883c33-5f31-4a53-b117-0fe975bce512',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=6771cbc4-3e4b-419f-b87f-2db662f6e010,mac_address=fa:16:3e:50:c6:c9,name='',network_id=e8e0564a-d5c9-4fe0-b2d4-538f45096708,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(6771cbc4-3e4b-419f-b87f-2db662f6e010),security_group_ids=set([]),status='DOWN',updated_at=2022-09-04T01:05:03Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:04.916633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-c68acbef-90c9-445c-8fc8-ae574498ff8d admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (6771cbc4-3e4b-419f-b87f-2db662f6e010), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:05.316317 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-79e93433-5f4e-43b2-a8f0-09352d58d0c7 admin admin] Received resource Port update without any changes: a62a40a2-96f5-427a-808e-9e63c8644245 {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:181}} Sep 04 01:05:05.450807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Configuration for devices up ['3c278ab2-dc61-40f8-ab29-c8cc8b740d7d', '53e7a39c-e9ce-45c4-84af-632f2aac70ae'] and devices down [] completed. Sep 04 01:05:05.451343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:252 - ports processed. Elapsed:3.674 Sep 04 01:05:05.451519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:252 completed. Processed ports statistics: {'regular': {'added': 2, 'updated': 2, 'removed': 0}}. Elapsed:3.674 Sep 04 01:05:05.453101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Loop iteration exceeded interval (2 vs. 3.6744539737701416)! {{(pid=107812) loop_count_and_wait /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2496}} Sep 04 01:05:05.453401 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:253 started Sep 04 01:05:05.457312 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade54c9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=848000000,duration_sec=514,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:05:05.460094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:05:05.460987 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:253 - starting polling. Elapsed:0.008 Sep 04 01:05:05.463540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:05.468552 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:253 - port information retrieved. Elapsed:0.015 Sep 04 01:05:05.473388 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Starting to process devices in:{'current': {'3fa24970-97a7-4f46-ac55-0b24323fa402', '9b82da41-d694-43b0-a43b-5998addaf0bf', '3c278ab2-dc61-40f8-ab29-c8cc8b740d7d', '0a1a9f7e-73de-4620-ae03-4b1d50d7f706', '89aa06b4-bbf1-40c2-bb48-500c3aecdf48', 'f45b435f-0f64-41fe-a6ec-36683da765f9', '53e7a39c-e9ce-45c4-84af-632f2aac70ae', '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', 'dd44c60a-dd0f-4ff2-85ae-8c012af89cf9', 'ca102ce7-433c-4029-aabf-33d944165ff1'}, 'added': {'dd44c60a-dd0f-4ff2-85ae-8c012af89cf9', '0a1a9f7e-73de-4620-ae03-4b1d50d7f706', 'f45b435f-0f64-41fe-a6ec-36683da765f9'}, 'removed': set(), 'updated': {'3c278ab2-dc61-40f8-ab29-c8cc8b740d7d', '0a1a9f7e-73de-4620-ae03-4b1d50d7f706', 'f45b435f-0f64-41fe-a6ec-36683da765f9', '53e7a39c-e9ce-45c4-84af-632f2aac70ae', 'dd44c60a-dd0f-4ff2-85ae-8c012af89cf9'}, 're_added': set()} {{(pid=107812) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 04 01:05:05.475137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': '3c278ab2-dc61-40f8-ab29-c8cc8b740d7d', 'device_id': 'a8e13541-9272-4fa2-a9ff-940907d6ba01', 'network_id': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'port_id': '3c278ab2-dc61-40f8-ab29-c8cc8b740d7d', 'mac_address': 'fa:16:3e:92:fb:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '2b17f894-c374-4207-90ad-14f794c86627', 'ip_address': '172.37.7.191'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 01:05:05.475780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': '0a1a9f7e-73de-4620-ae03-4b1d50d7f706', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-d7f39628-666e-4480-8bee-49de183d5e09', 'network_id': 'd7f39628-666e-4480-8bee-49de183d5e09', 'port_id': '0a1a9f7e-73de-4620-ae03-4b1d50d7f706', 'mac_address': 'fa:16:3e:d1:46:c7', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 172, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '1af847f5-eeac-4b3d-afa5-aa099062676b', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 01:05:05.478116 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': 'f45b435f-0f64-41fe-a6ec-36683da765f9', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-b16f22e1-6fb1-440b-98eb-845123e960e6', 'network_id': 'b16f22e1-6fb1-440b-98eb-845123e960e6', 'port_id': 'f45b435f-0f64-41fe-a6ec-36683da765f9', 'mac_address': 'fa:16:3e:eb:c4:7f', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 174, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '35ea244b-d6a3-4c9a-a9b3-3f9d2814dee0', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 01:05:05.478611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': '53e7a39c-e9ce-45c4-84af-632f2aac70ae', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-3e702e6e-ebe1-46a7-b30d-f3d140ac2993', 'network_id': '3e702e6e-ebe1-46a7-b30d-f3d140ac2993', 'port_id': '53e7a39c-e9ce-45c4-84af-632f2aac70ae', 'mac_address': 'fa:16:3e:f4:97:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 167, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'b8f8e824-5e09-4bb6-bfba-faf43aae1f44', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 01:05:05.480002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': 'dd44c60a-dd0f-4ff2-85ae-8c012af89cf9', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-1fb5aed8-696d-4f87-8b2a-7d29744538a8', 'network_id': '1fb5aed8-696d-4f87-8b2a-7d29744538a8', 'port_id': 'dd44c60a-dd0f-4ff2-85ae-8c012af89cf9', 'mac_address': 'fa:16:3e:6f:ff:ef', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 193, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'cf87fd90-4193-4f02-8ccd-ce8ccea66ca5', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 01:05:05.489420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: 3c278ab2-dc61-40f8-ab29-c8cc8b740d7d {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:05:05.490285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 3c278ab2-dc61-40f8-ab29-c8cc8b740d7d updated. Details: {'device': '3c278ab2-dc61-40f8-ab29-c8cc8b740d7d', 'device_id': 'a8e13541-9272-4fa2-a9ff-940907d6ba01', 'network_id': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'port_id': '3c278ab2-dc61-40f8-ab29-c8cc8b740d7d', 'mac_address': 'fa:16:3e:92:fb:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '2b17f894-c374-4207-90ad-14f794c86627', 'ip_address': '172.37.7.191'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 04 01:05:05.493220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-3c278ab2-dc, col_values=(('tag', 2),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:05.495399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-3c278ab2-dc, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:05.498558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-3c278ab2-dc, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:05.498558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 01:05:05.502252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-3c278ab2-dc, col_values=(('other_config', {'net_uuid': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:05.502948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 01:05:05.512070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade54cb,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 8}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:05:05.512412 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: 0a1a9f7e-73de-4620-ae03-4b1d50d7f706 {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:05:05.512813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 0a1a9f7e-73de-4620-ae03-4b1d50d7f706 updated. Details: {'device': '0a1a9f7e-73de-4620-ae03-4b1d50d7f706', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-d7f39628-666e-4480-8bee-49de183d5e09', 'network_id': 'd7f39628-666e-4480-8bee-49de183d5e09', 'port_id': '0a1a9f7e-73de-4620-ae03-4b1d50d7f706', 'mac_address': 'fa:16:3e:d1:46:c7', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 172, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '1af847f5-eeac-4b3d-afa5-aa099062676b', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Sep 04 01:05:05.513883 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Assigning 6 as local vlan for net-id=d7f39628-666e-4480-8bee-49de183d5e09, seg-id=172 Sep 04 01:05:05.519561 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0x1fd38bf7,OFPFlowMod(buffer_id=4294967295,command=0,cookie=6561907047025962751,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4268), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4102}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:05:05.531763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0xeade54cd,OFPFlowMod(buffer_id=4294967295,command=0,cookie=6887031442322345889,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4102)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4268}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:05:05.532919 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap0a1a9f7e-73, col_values=(('tag', 6),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:05.533380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap0a1a9f7e-73, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:05.533819 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap0a1a9f7e-73, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:05.543347 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap0a1a9f7e-73, col_values=(('other_config', {'net_uuid': 'd7f39628-666e-4480-8bee-49de183d5e09', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '6', 'segmentation_id': '172'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:05.563604 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade54cf,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 11}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:05:05.563978 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: f45b435f-0f64-41fe-a6ec-36683da765f9 {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:05:05.566615 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port f45b435f-0f64-41fe-a6ec-36683da765f9 updated. Details: {'device': 'f45b435f-0f64-41fe-a6ec-36683da765f9', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-b16f22e1-6fb1-440b-98eb-845123e960e6', 'network_id': 'b16f22e1-6fb1-440b-98eb-845123e960e6', 'port_id': 'f45b435f-0f64-41fe-a6ec-36683da765f9', 'mac_address': 'fa:16:3e:eb:c4:7f', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 174, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '35ea244b-d6a3-4c9a-a9b3-3f9d2814dee0', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Sep 04 01:05:05.568262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Assigning 7 as local vlan for net-id=b16f22e1-6fb1-440b-98eb-845123e960e6, seg-id=174 Sep 04 01:05:05.575503 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0x1fd38bf9,OFPFlowMod(buffer_id=4294967295,command=0,cookie=6561907047025962751,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4270), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4103}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:05:05.586012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0xeade54d1,OFPFlowMod(buffer_id=4294967295,command=0,cookie=6887031442322345889,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4103)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4270}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:05:05.604491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapf45b435f-0f, col_values=(('tag', 7),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:05.604996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tapf45b435f-0f, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:05.605458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tapf45b435f-0f, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:05.622228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapf45b435f-0f, col_values=(('other_config', {'net_uuid': 'b16f22e1-6fb1-440b-98eb-845123e960e6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '7', 'segmentation_id': '174'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:05.656561 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade54d3,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 10}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:05:05.659513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: 53e7a39c-e9ce-45c4-84af-632f2aac70ae {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:05:05.660347 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 53e7a39c-e9ce-45c4-84af-632f2aac70ae updated. Details: {'device': '53e7a39c-e9ce-45c4-84af-632f2aac70ae', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-3e702e6e-ebe1-46a7-b30d-f3d140ac2993', 'network_id': '3e702e6e-ebe1-46a7-b30d-f3d140ac2993', 'port_id': '53e7a39c-e9ce-45c4-84af-632f2aac70ae', 'mac_address': 'fa:16:3e:f4:97:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 167, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'b8f8e824-5e09-4bb6-bfba-faf43aae1f44', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 5} Sep 04 01:05:05.677672 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap53e7a39c-e9, col_values=(('tag', 5),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:05.678937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap53e7a39c-e9, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:05.681536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap53e7a39c-e9, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:05.682118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 01:05:05.684027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap53e7a39c-e9, col_values=(('other_config', {'net_uuid': '3e702e6e-ebe1-46a7-b30d-f3d140ac2993', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '167', 'tag': '5'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:05.692516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 01:05:05.697314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade54d5,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 7}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:05:05.698596 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: dd44c60a-dd0f-4ff2-85ae-8c012af89cf9 {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:05:05.703189 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port dd44c60a-dd0f-4ff2-85ae-8c012af89cf9 updated. Details: {'device': 'dd44c60a-dd0f-4ff2-85ae-8c012af89cf9', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-1fb5aed8-696d-4f87-8b2a-7d29744538a8', 'network_id': '1fb5aed8-696d-4f87-8b2a-7d29744538a8', 'port_id': 'dd44c60a-dd0f-4ff2-85ae-8c012af89cf9', 'mac_address': 'fa:16:3e:6f:ff:ef', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 193, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'cf87fd90-4193-4f02-8ccd-ce8ccea66ca5', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Sep 04 01:05:05.703769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Assigning 8 as local vlan for net-id=1fb5aed8-696d-4f87-8b2a-7d29744538a8, seg-id=193 Sep 04 01:05:05.714269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0x1fd38bfb,OFPFlowMod(buffer_id=4294967295,command=0,cookie=6561907047025962751,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4289), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4104}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:05:05.717779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0xeade54d7,OFPFlowMod(buffer_id=4294967295,command=0,cookie=6887031442322345889,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4104)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4289}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:05:05.724391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapdd44c60a-dd, col_values=(('tag', 8),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:05.727986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tapdd44c60a-dd, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:05.729582 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tapdd44c60a-dd, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:05.763369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapdd44c60a-dd, col_values=(('other_config', {'net_uuid': '1fb5aed8-696d-4f87-8b2a-7d29744538a8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '8', 'segmentation_id': '193'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:05.789796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade54d9,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 9}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:05:05.790478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:253 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 10 devices currently available. Time elapsed: 0.317 Sep 04 01:05:05.791013 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Preparing device filters for 3 new devices {{(pid=107812) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 04 01:05:05.798331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Preparing filters for devices {'dd44c60a-dd0f-4ff2-85ae-8c012af89cf9', '0a1a9f7e-73de-4620-ae03-4b1d50d7f706', 'f45b435f-0f64-41fe-a6ec-36683da765f9'} Sep 04 01:05:05.798331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information for ports dict_keys([]) {{(pid=107812) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 04 01:05:05.798331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information {{(pid=107812) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 04 01:05:05.806115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 6 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:05:05.925505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed16845-5851-4e8c-a84c-57adb22cff1d]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:05:05.925505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Refreshing firewall for 2 devices {{(pid=107812) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 04 01:05:05.925505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Refresh firewall rules Sep 04 01:05:05.925505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information for ports dict_keys([]) {{(pid=107812) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 04 01:05:05.925505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information {{(pid=107812) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 04 01:05:05.930508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 4 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:05:06.015443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f8d875-2742-49de-b09e-40dc6af08a34]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:05:06.016154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:253 - agent port security group processed in 0.542 Sep 04 01:05:06.017203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for 3c278ab2-dc61-40f8-ab29-c8cc8b740d7d to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 01:05:06.017660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for 0a1a9f7e-73de-4620-ae03-4b1d50d7f706 to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 01:05:06.017996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for f45b435f-0f64-41fe-a6ec-36683da765f9 to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 01:05:06.018356 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for 53e7a39c-e9ce-45c4-84af-632f2aac70ae to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 01:05:06.018713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for dd44c60a-dd0f-4ff2-85ae-8c012af89cf9 to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 01:05:06.680455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-07c611e7-e485-48a8-b092-2d799237459e admin admin] Resource Network deleted: bb66909c-9291-477a-9f2b-a9f4b56d351c {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:06.682251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-07c611e7-e485-48a8-b092-2d799237459e admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533'] for Network (bb66909c-9291-477a-9f2b-a9f4b56d351c), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:06.862661 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-65447111-00a5-4912-aed9-6bd458e2d923 None None] Resource Port f45b435f-0f64-41fe-a6ec-36683da765f9 updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:05:06.866918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-65447111-00a5-4912-aed9-6bd458e2d923 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (f45b435f-0f64-41fe-a6ec-36683da765f9), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:06.912683 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-6039cc52-1bc2-4655-a2c8-061d14012a3a None None] Resource Port 1cf499fb-10a0-4af2-afec-5f610dc85da6 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=1cf499fb-10a0-4af2-afec-5f610dc85da6,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=1cf499fb-10a0-4af2-afec-5f610dc85da6,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:05:06.913436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-6039cc52-1bc2-4655-a2c8-061d14012a3a None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (1cf499fb-10a0-4af2-afec-5f610dc85da6), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:07.070855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-6039cc52-1bc2-4655-a2c8-061d14012a3a None None] Resource Port 1cf499fb-10a0-4af2-afec-5f610dc85da6 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=1cf499fb-10a0-4af2-afec-5f610dc85da6,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=1cf499fb-10a0-4af2-afec-5f610dc85da6,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=1cf499fb-10a0-4af2-afec-5f610dc85da6,segment=NetworkSegment(c26850af-ca47-4ea8-9a33-a34f3381800e),segment_id=c26850af-ca47-4ea8-9a33-a34f3381800e)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:05:07.071526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-6039cc52-1bc2-4655-a2c8-061d14012a3a None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (1cf499fb-10a0-4af2-afec-5f610dc85da6), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:07.142408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-9fc6d6a7-d245-4bf0-853b-19962333f23c admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:05:06Z,description='Default security group',id=c36dd10d-1a18-4c9a-bf78-dc2aac520956,is_default=True,name='default',project_id='bac331f898134ea787f4eb29b701b3ea',revision_number=1,rules=[SecurityGroupRule(27c401b5-b4a0-4ff3-a40c-9543598c26a4),SecurityGroupRule(686d78e0-065b-4566-929d-a452255f3b89),SecurityGroupRule(a45622d4-53a3-4531-81a0-e2276628e5aa),SecurityGroupRule(e235c9b5-ff7b-46ed-8f75-1f82cf31fe74)],shared=False,stateful=True,updated_at=2022-09-04T01:05:06Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:07.143309 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-9fc6d6a7-d245-4bf0-853b-19962333f23c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (c36dd10d-1a18-4c9a-bf78-dc2aac520956), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:07.144669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-9fc6d6a7-d245-4bf0-853b-19962333f23c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:05:06Z,description=,direction='egress',ethertype='IPv4',id=27c401b5-b4a0-4ff3-a40c-9543598c26a4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='bac331f898134ea787f4eb29b701b3ea',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c36dd10d-1a18-4c9a-bf78-dc2aac520956,updated_at=2022-09-04T01:05:06Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:07.145245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-9fc6d6a7-d245-4bf0-853b-19962333f23c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (27c401b5-b4a0-4ff3-a40c-9543598c26a4), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:07.145915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-9fc6d6a7-d245-4bf0-853b-19962333f23c admin admin] Security group rule updated ['c36dd10d-1a18-4c9a-bf78-dc2aac520956'] Sep 04 01:05:07.146795 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-9fc6d6a7-d245-4bf0-853b-19962333f23c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:05:06Z,description=,direction='egress',ethertype='IPv6',id=686d78e0-065b-4566-929d-a452255f3b89,normalized_cidr=None,port_range_max=,port_range_min=,project_id='bac331f898134ea787f4eb29b701b3ea',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c36dd10d-1a18-4c9a-bf78-dc2aac520956,updated_at=2022-09-04T01:05:06Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:07.147316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-9fc6d6a7-d245-4bf0-853b-19962333f23c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (686d78e0-065b-4566-929d-a452255f3b89), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:07.147888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-9fc6d6a7-d245-4bf0-853b-19962333f23c admin admin] Security group rule updated ['c36dd10d-1a18-4c9a-bf78-dc2aac520956'] Sep 04 01:05:07.148848 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-9fc6d6a7-d245-4bf0-853b-19962333f23c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:05:06Z,description=,direction='ingress',ethertype='IPv4',id=a45622d4-53a3-4531-81a0-e2276628e5aa,normalized_cidr=None,port_range_max=,port_range_min=,project_id='bac331f898134ea787f4eb29b701b3ea',protocol=,remote_address_group_id=,remote_group_id=c36dd10d-1a18-4c9a-bf78-dc2aac520956,remote_ip_prefix=,revision_number=0,security_group_id=c36dd10d-1a18-4c9a-bf78-dc2aac520956,updated_at=2022-09-04T01:05:06Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:07.150442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-9fc6d6a7-d245-4bf0-853b-19962333f23c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (a45622d4-53a3-4531-81a0-e2276628e5aa), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:07.152028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-9fc6d6a7-d245-4bf0-853b-19962333f23c admin admin] Security group rule updated ['c36dd10d-1a18-4c9a-bf78-dc2aac520956'] Sep 04 01:05:07.154107 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-9fc6d6a7-d245-4bf0-853b-19962333f23c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:05:06Z,description=,direction='ingress',ethertype='IPv6',id=e235c9b5-ff7b-46ed-8f75-1f82cf31fe74,normalized_cidr=None,port_range_max=,port_range_min=,project_id='bac331f898134ea787f4eb29b701b3ea',protocol=,remote_address_group_id=,remote_group_id=c36dd10d-1a18-4c9a-bf78-dc2aac520956,remote_ip_prefix=,revision_number=0,security_group_id=c36dd10d-1a18-4c9a-bf78-dc2aac520956,updated_at=2022-09-04T01:05:06Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:07.154868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-9fc6d6a7-d245-4bf0-853b-19962333f23c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (e235c9b5-ff7b-46ed-8f75-1f82cf31fe74), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:07.159250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-9fc6d6a7-d245-4bf0-853b-19962333f23c admin admin] Security group rule updated ['c36dd10d-1a18-4c9a-bf78-dc2aac520956'] Sep 04 01:05:07.300793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-65447111-00a5-4912-aed9-6bd458e2d923 None None] Resource Port 0a1a9f7e-73de-4620-ae03-4b1d50d7f706 updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:05:07.301678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-65447111-00a5-4912-aed9-6bd458e2d923 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (0a1a9f7e-73de-4620-ae03-4b1d50d7f706), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:07.419270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-169521a7-efd7-43f0-ab94-690942d86b8b None None] Resource Port 3045b911-01c5-4fc3-8e89-ac2d9cea12a8 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=3045b911-01c5-4fc3-8e89-ac2d9cea12a8,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=3045b911-01c5-4fc3-8e89-ac2d9cea12a8,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:05:07.433281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-169521a7-efd7-43f0-ab94-690942d86b8b None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (3045b911-01c5-4fc3-8e89-ac2d9cea12a8), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:07.508420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-baf55837-0e92-4aa1-8034-d9bb083b0ef9 admin admin] Resource SecurityGroup deleted: c36dd10d-1a18-4c9a-bf78-dc2aac520956 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:07.508910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-baf55837-0e92-4aa1-8034-d9bb083b0ef9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (c36dd10d-1a18-4c9a-bf78-dc2aac520956), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:07.509507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-baf55837-0e92-4aa1-8034-d9bb083b0ef9 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('c36dd10d-1a18-4c9a-bf78-dc2aac520956',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:05:07.549751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-25c4180b-2e7e-4d99-a147-e56fe9c7f82d admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:05:06Z,data_plane_status=None,description='',device_id='d7fde424-29f8-4dba-95d8-51709b034af5',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=378bbdd4-3077-4657-8055-fdc0a7600948,mac_address=fa:16:3e:0e:91:eb,name='',network_id=1fb5aed8-696d-4f87-8b2a-7d29744538a8,numa_affinity_policy=,project_id='e7dca68418a14d7da9aa63ac25f202e8',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(378bbdd4-3077-4657-8055-fdc0a7600948),security_group_ids=set([]),status='DOWN',updated_at=2022-09-04T01:05:06Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:07.550150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-25c4180b-2e7e-4d99-a147-e56fe9c7f82d admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (378bbdd4-3077-4657-8055-fdc0a7600948), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:07.572102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-baf55837-0e92-4aa1-8034-d9bb083b0ef9 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('c36dd10d-1a18-4c9a-bf78-dc2aac520956',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:05:07.572848 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-baf55837-0e92-4aa1-8034-d9bb083b0ef9 admin admin] Resource SecurityGroupRule deleted: 27c401b5-b4a0-4ff3-a40c-9543598c26a4 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:07.573381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-baf55837-0e92-4aa1-8034-d9bb083b0ef9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (27c401b5-b4a0-4ff3-a40c-9543598c26a4), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:07.573919 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-baf55837-0e92-4aa1-8034-d9bb083b0ef9 admin admin] Security group rule updated ['c36dd10d-1a18-4c9a-bf78-dc2aac520956'] Sep 04 01:05:07.574641 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-baf55837-0e92-4aa1-8034-d9bb083b0ef9 admin admin] Resource SecurityGroupRule deleted: 686d78e0-065b-4566-929d-a452255f3b89 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:07.575132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-baf55837-0e92-4aa1-8034-d9bb083b0ef9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (686d78e0-065b-4566-929d-a452255f3b89), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:07.575823 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-baf55837-0e92-4aa1-8034-d9bb083b0ef9 admin admin] Security group rule updated ['c36dd10d-1a18-4c9a-bf78-dc2aac520956'] Sep 04 01:05:07.576493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-baf55837-0e92-4aa1-8034-d9bb083b0ef9 admin admin] Resource SecurityGroupRule deleted: a45622d4-53a3-4531-81a0-e2276628e5aa {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:07.577003 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-baf55837-0e92-4aa1-8034-d9bb083b0ef9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (a45622d4-53a3-4531-81a0-e2276628e5aa), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:07.577536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-baf55837-0e92-4aa1-8034-d9bb083b0ef9 admin admin] Security group rule updated ['c36dd10d-1a18-4c9a-bf78-dc2aac520956'] Sep 04 01:05:07.580256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-baf55837-0e92-4aa1-8034-d9bb083b0ef9 admin admin] Resource SecurityGroupRule deleted: e235c9b5-ff7b-46ed-8f75-1f82cf31fe74 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:07.581051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-baf55837-0e92-4aa1-8034-d9bb083b0ef9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (e235c9b5-ff7b-46ed-8f75-1f82cf31fe74), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:07.582426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-baf55837-0e92-4aa1-8034-d9bb083b0ef9 admin admin] Security group rule updated ['c36dd10d-1a18-4c9a-bf78-dc2aac520956'] Sep 04 01:05:07.662865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-881e22f6-4783-40ba-8b92-139d326c15c1 admin admin] Resource Subnet deleted: 14ddfef7-ea16-41a8-8988-1fdad0c9c4f9 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:07.663290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-881e22f6-4783-40ba-8b92-139d326c15c1 admin admin] Publish callbacks [] for Subnet (14ddfef7-ea16-41a8-8988-1fdad0c9c4f9), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:07.672656 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-169521a7-efd7-43f0-ab94-690942d86b8b None None] Resource Port 3045b911-01c5-4fc3-8e89-ac2d9cea12a8 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=3045b911-01c5-4fc3-8e89-ac2d9cea12a8,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=3045b911-01c5-4fc3-8e89-ac2d9cea12a8,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=3045b911-01c5-4fc3-8e89-ac2d9cea12a8,segment=NetworkSegment(c26850af-ca47-4ea8-9a33-a34f3381800e),segment_id=c26850af-ca47-4ea8-9a33-a34f3381800e)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:05:07.673149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-169521a7-efd7-43f0-ab94-690942d86b8b None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (3045b911-01c5-4fc3-8e89-ac2d9cea12a8), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:07.960306 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["59dff06f-11d0-4303-a7d7-9efc16a26866","insert","qg-1cf499fb-10",["set",[]],["map",[["attached-mac","fa:16:3e:8a:3e:25"],["iface-id","1cf499fb-10a0-4af2-afec-5f610dc85da6"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:05:07.979576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["59dff06f-11d0-4303-a7d7-9efc16a26866","old",null,["set",[]],null],["","new","qg-1cf499fb-10",12,["map",[["attached-mac","fa:16:3e:8a:3e:25"],["iface-id","1cf499fb-10a0-4af2-afec-5f610dc85da6"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:05:08.138797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-65447111-00a5-4912-aed9-6bd458e2d923 None None] Resource Port dd44c60a-dd0f-4ff2-85ae-8c012af89cf9 updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:05:08.139417 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-65447111-00a5-4912-aed9-6bd458e2d923 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (dd44c60a-dd0f-4ff2-85ae-8c012af89cf9), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:09.282981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-477e8205-36be-4d4e-abb4-97779e7fc211 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:05:08Z,description='Default security group',id=10b7b28d-44b1-401c-a13e-91aafb27f1fb,is_default=True,name='default',project_id='f14a3f986b774cb09bd5cc3f9ebeaac3',revision_number=1,rules=[SecurityGroupRule(25d4608c-c21c-4704-8f08-2dc03f387cec),SecurityGroupRule(3ecfe154-065e-4f0a-9e0a-8d88d2dddb02),SecurityGroupRule(3f393dad-fb66-4e0a-9814-5ae5d1876d3a),SecurityGroupRule(97854ad6-fd9e-4eab-9029-cd1a52ec50c4)],shared=False,stateful=True,updated_at=2022-09-04T01:05:08Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:09.285668 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-477e8205-36be-4d4e-abb4-97779e7fc211 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (10b7b28d-44b1-401c-a13e-91aafb27f1fb), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:09.287305 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-477e8205-36be-4d4e-abb4-97779e7fc211 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:05:08Z,description=,direction='ingress',ethertype='IPv4',id=25d4608c-c21c-4704-8f08-2dc03f387cec,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f14a3f986b774cb09bd5cc3f9ebeaac3',protocol=,remote_address_group_id=,remote_group_id=10b7b28d-44b1-401c-a13e-91aafb27f1fb,remote_ip_prefix=,revision_number=0,security_group_id=10b7b28d-44b1-401c-a13e-91aafb27f1fb,updated_at=2022-09-04T01:05:08Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:09.287764 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-477e8205-36be-4d4e-abb4-97779e7fc211 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (25d4608c-c21c-4704-8f08-2dc03f387cec), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:09.288188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-477e8205-36be-4d4e-abb4-97779e7fc211 admin admin] Security group rule updated ['10b7b28d-44b1-401c-a13e-91aafb27f1fb'] Sep 04 01:05:09.292480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-477e8205-36be-4d4e-abb4-97779e7fc211 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:05:08Z,description=,direction='ingress',ethertype='IPv6',id=3ecfe154-065e-4f0a-9e0a-8d88d2dddb02,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f14a3f986b774cb09bd5cc3f9ebeaac3',protocol=,remote_address_group_id=,remote_group_id=10b7b28d-44b1-401c-a13e-91aafb27f1fb,remote_ip_prefix=,revision_number=0,security_group_id=10b7b28d-44b1-401c-a13e-91aafb27f1fb,updated_at=2022-09-04T01:05:08Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:09.292911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-477e8205-36be-4d4e-abb4-97779e7fc211 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (3ecfe154-065e-4f0a-9e0a-8d88d2dddb02), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:09.293504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-477e8205-36be-4d4e-abb4-97779e7fc211 admin admin] Security group rule updated ['10b7b28d-44b1-401c-a13e-91aafb27f1fb'] Sep 04 01:05:09.302133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-477e8205-36be-4d4e-abb4-97779e7fc211 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:05:08Z,description=,direction='egress',ethertype='IPv6',id=3f393dad-fb66-4e0a-9814-5ae5d1876d3a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f14a3f986b774cb09bd5cc3f9ebeaac3',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=10b7b28d-44b1-401c-a13e-91aafb27f1fb,updated_at=2022-09-04T01:05:08Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:09.302697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-477e8205-36be-4d4e-abb4-97779e7fc211 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (3f393dad-fb66-4e0a-9814-5ae5d1876d3a), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:09.303044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-477e8205-36be-4d4e-abb4-97779e7fc211 admin admin] Security group rule updated ['10b7b28d-44b1-401c-a13e-91aafb27f1fb'] Sep 04 01:05:09.305128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-477e8205-36be-4d4e-abb4-97779e7fc211 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:05:08Z,description=,direction='egress',ethertype='IPv4',id=97854ad6-fd9e-4eab-9029-cd1a52ec50c4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f14a3f986b774cb09bd5cc3f9ebeaac3',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=10b7b28d-44b1-401c-a13e-91aafb27f1fb,updated_at=2022-09-04T01:05:08Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:09.315991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-477e8205-36be-4d4e-abb4-97779e7fc211 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (97854ad6-fd9e-4eab-9029-cd1a52ec50c4), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:09.317333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-477e8205-36be-4d4e-abb4-97779e7fc211 admin admin] Security group rule updated ['10b7b28d-44b1-401c-a13e-91aafb27f1fb'] Sep 04 01:05:09.322509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-6f6b76e9-09ec-4edf-98cf-70fb5b1defa1 None None] Resource Port a62a40a2-96f5-427a-808e-9e63c8644245 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=a62a40a2-96f5-427a-808e-9e63c8644245,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=a62a40a2-96f5-427a-808e-9e63c8644245,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:05:09.323146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-6f6b76e9-09ec-4edf-98cf-70fb5b1defa1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (a62a40a2-96f5-427a-808e-9e63c8644245), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:09.756017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-11ffc4a4-fb4e-4476-bbca-d91e9e319165 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:05:08Z,data_plane_status=None,description='',device_id='e4262b22-bfcc-4362-b0da-5c283cfb2e9a',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=c2f724af-5dbd-4d91-83cd-c5152b744599,mac_address=fa:16:3e:fb:1a:e1,name='',network_id=3e702e6e-ebe1-46a7-b30d-f3d140ac2993,numa_affinity_policy=,project_id='55faed42b7f243df9df879d581797f56',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(c2f724af-5dbd-4d91-83cd-c5152b744599),security_group_ids=set([]),status='DOWN',updated_at=2022-09-04T01:05:08Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:09.756412 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-11ffc4a4-fb4e-4476-bbca-d91e9e319165 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (c2f724af-5dbd-4d91-83cd-c5152b744599), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:09.799320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-600b7f22-e9d9-40e4-9b1d-90a0ed83b548 admin admin] Resource SecurityGroup deleted: 10b7b28d-44b1-401c-a13e-91aafb27f1fb {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:09.799866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-600b7f22-e9d9-40e4-9b1d-90a0ed83b548 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (10b7b28d-44b1-401c-a13e-91aafb27f1fb), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:09.800478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-600b7f22-e9d9-40e4-9b1d-90a0ed83b548 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('10b7b28d-44b1-401c-a13e-91aafb27f1fb',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:05:09.873369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-6f6b76e9-09ec-4edf-98cf-70fb5b1defa1 None None] Resource Port a62a40a2-96f5-427a-808e-9e63c8644245 updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=a62a40a2-96f5-427a-808e-9e63c8644245,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=a62a40a2-96f5-427a-808e-9e63c8644245,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=a62a40a2-96f5-427a-808e-9e63c8644245,segment=NetworkSegment(fa03338c-c7bc-4666-a251-ff3dadbd2af6),segment_id=fa03338c-c7bc-4666-a251-ff3dadbd2af6)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:05:09.873369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-6f6b76e9-09ec-4edf-98cf-70fb5b1defa1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (a62a40a2-96f5-427a-808e-9e63c8644245), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:10.025111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-92b2ba7b-f7fb-4fc1-bf51-15e134763a75 admin admin] Resource Network deleted: 24c98e7f-be01-4588-b989-3d3624ceef7c {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:10.025978 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-92b2ba7b-f7fb-4fc1-bf51-15e134763a75 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533'] for Network (24c98e7f-be01-4588-b989-3d3624ceef7c), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:10.724362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-600b7f22-e9d9-40e4-9b1d-90a0ed83b548 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('10b7b28d-44b1-401c-a13e-91aafb27f1fb',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:05:10.725503 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-600b7f22-e9d9-40e4-9b1d-90a0ed83b548 admin admin] Resource SecurityGroupRule deleted: 25d4608c-c21c-4704-8f08-2dc03f387cec {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:10.726145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-600b7f22-e9d9-40e4-9b1d-90a0ed83b548 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (25d4608c-c21c-4704-8f08-2dc03f387cec), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:10.726699 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-600b7f22-e9d9-40e4-9b1d-90a0ed83b548 admin admin] Security group rule updated ['10b7b28d-44b1-401c-a13e-91aafb27f1fb'] Sep 04 01:05:10.727345 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-600b7f22-e9d9-40e4-9b1d-90a0ed83b548 admin admin] Resource SecurityGroupRule deleted: 3ecfe154-065e-4f0a-9e0a-8d88d2dddb02 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:10.727948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-600b7f22-e9d9-40e4-9b1d-90a0ed83b548 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (3ecfe154-065e-4f0a-9e0a-8d88d2dddb02), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:10.728472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-600b7f22-e9d9-40e4-9b1d-90a0ed83b548 admin admin] Security group rule updated ['10b7b28d-44b1-401c-a13e-91aafb27f1fb'] Sep 04 01:05:10.729377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-600b7f22-e9d9-40e4-9b1d-90a0ed83b548 admin admin] Resource SecurityGroupRule deleted: 3f393dad-fb66-4e0a-9814-5ae5d1876d3a {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:10.730067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-600b7f22-e9d9-40e4-9b1d-90a0ed83b548 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (3f393dad-fb66-4e0a-9814-5ae5d1876d3a), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:10.731145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-600b7f22-e9d9-40e4-9b1d-90a0ed83b548 admin admin] Security group rule updated ['10b7b28d-44b1-401c-a13e-91aafb27f1fb'] Sep 04 01:05:10.731786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-600b7f22-e9d9-40e4-9b1d-90a0ed83b548 admin admin] Resource SecurityGroupRule deleted: 97854ad6-fd9e-4eab-9029-cd1a52ec50c4 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:10.732489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-600b7f22-e9d9-40e4-9b1d-90a0ed83b548 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (97854ad6-fd9e-4eab-9029-cd1a52ec50c4), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:10.733028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-600b7f22-e9d9-40e4-9b1d-90a0ed83b548 admin admin] Security group rule updated ['10b7b28d-44b1-401c-a13e-91aafb27f1fb'] Sep 04 01:05:10.786888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["c00bf884-564b-46cb-8db2-bbfc97020010","insert","qr-a62a40a2-96",["set",[]],["map",[["attached-mac","fa:16:3e:dd:cb:78"],["iface-id","a62a40a2-96f5-427a-808e-9e63c8644245"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:05:10.811043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["c00bf884-564b-46cb-8db2-bbfc97020010","old",null,["set",[]],null],["","new","qr-a62a40a2-96",13,["map",[["attached-mac","fa:16:3e:dd:cb:78"],["iface-id","a62a40a2-96f5-427a-808e-9e63c8644245"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:05:11.088713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-efc547c0-657d-46c2-afa0-cc8fcafcd00b None None] Resource Port 4ed942cd-0f45-4d77-a66d-1d6c875877dc updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=4ed942cd-0f45-4d77-a66d-1d6c875877dc,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=4ed942cd-0f45-4d77-a66d-1d6c875877dc,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:05:11.089379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-efc547c0-657d-46c2-afa0-cc8fcafcd00b None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (4ed942cd-0f45-4d77-a66d-1d6c875877dc), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:11.132516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-25c4180b-2e7e-4d99-a147-e56fe9c7f82d admin admin] Received resource Port update without any changes: 378bbdd4-3077-4657-8055-fdc0a7600948 {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:181}} Sep 04 01:05:11.206077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["8bc3b20d-d676-4582-96f8-124edc43439f","insert","qg-3045b911-01",["set",[]],["map",[["attached-mac","fa:16:3e:f1:55:69"],["iface-id","3045b911-01c5-4fc3-8e89-ac2d9cea12a8"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:05:11.222153 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["8bc3b20d-d676-4582-96f8-124edc43439f","old",null,["set",[]],null],["","new","qg-3045b911-01",14,["map",[["attached-mac","fa:16:3e:f1:55:69"],["iface-id","3045b911-01c5-4fc3-8e89-ac2d9cea12a8"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:05:11.578204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-efc547c0-657d-46c2-afa0-cc8fcafcd00b None None] Resource Port 4ed942cd-0f45-4d77-a66d-1d6c875877dc updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=4ed942cd-0f45-4d77-a66d-1d6c875877dc,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=4ed942cd-0f45-4d77-a66d-1d6c875877dc,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=4ed942cd-0f45-4d77-a66d-1d6c875877dc,segment=NetworkSegment(c26850af-ca47-4ea8-9a33-a34f3381800e),segment_id=c26850af-ca47-4ea8-9a33-a34f3381800e)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:05:11.578204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-efc547c0-657d-46c2-afa0-cc8fcafcd00b None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (4ed942cd-0f45-4d77-a66d-1d6c875877dc), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:11.906522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-11ffc4a4-fb4e-4476-bbca-d91e9e319165 admin admin] Received resource Port update without any changes: c2f724af-5dbd-4d91-83cd-c5152b744599 {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:181}} Sep 04 01:05:12.130340 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-d864986a-44e5-42f1-bf82-dff3ac84c6c4 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:05:10Z,data_plane_status=None,description='',device_id='a6875d57-1898-4fcc-8186-5995078e83c1',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=a6788698-0516-4d8a-8fe8-2add6e7f6e94,mac_address=fa:16:3e:f9:50:ed,name='',network_id=d7f39628-666e-4480-8bee-49de183d5e09,numa_affinity_policy=,project_id='287d111f08ac4b05bd5adec9c40d0620',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(a6788698-0516-4d8a-8fe8-2add6e7f6e94),security_group_ids=set([]),status='DOWN',updated_at=2022-09-04T01:05:10Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:12.131720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-d864986a-44e5-42f1-bf82-dff3ac84c6c4 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (a6788698-0516-4d8a-8fe8-2add6e7f6e94), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:13.106532 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-39357af2-03b0-48c2-a6e9-8adcd02e68a6 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:05:11Z,data_plane_status=None,description='',device_id='61883c33-5f31-4a53-b117-0fe975bce512',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=f38c3884-111a-49d9-bcf1-6a965ff5e110,mac_address=fa:16:3e:62:0b:90,name='',network_id=b16f22e1-6fb1-440b-98eb-845123e960e6,numa_affinity_policy=,project_id='db72b63281384bd883b04d05bcc35677',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(f38c3884-111a-49d9-bcf1-6a965ff5e110),security_group_ids=set([]),status='DOWN',updated_at=2022-09-04T01:05:11Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:13.108134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-39357af2-03b0-48c2-a6e9-8adcd02e68a6 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (f38c3884-111a-49d9-bcf1-6a965ff5e110), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:13.219422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4efb00ff-cf77-4a8f-be26-96116dc17c5b admin admin] Resource SecurityGroup deleted: 89d52eba-7e8a-41cf-b307-526f1c6f9c54 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:13.220946 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4efb00ff-cf77-4a8f-be26-96116dc17c5b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (89d52eba-7e8a-41cf-b307-526f1c6f9c54), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:13.222253 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4efb00ff-cf77-4a8f-be26-96116dc17c5b admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('89d52eba-7e8a-41cf-b307-526f1c6f9c54',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:05:13.467798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4efb00ff-cf77-4a8f-be26-96116dc17c5b admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('89d52eba-7e8a-41cf-b307-526f1c6f9c54',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:05:13.468275 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4efb00ff-cf77-4a8f-be26-96116dc17c5b admin admin] Resource SecurityGroupRule deleted: 322ab5db-ddef-4149-9e66-2ee7594df429 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:13.468654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4efb00ff-cf77-4a8f-be26-96116dc17c5b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (322ab5db-ddef-4149-9e66-2ee7594df429), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:13.469976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-4efb00ff-cf77-4a8f-be26-96116dc17c5b admin admin] Security group rule updated ['89d52eba-7e8a-41cf-b307-526f1c6f9c54'] Sep 04 01:05:13.470630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4efb00ff-cf77-4a8f-be26-96116dc17c5b admin admin] Resource SecurityGroupRule deleted: 7d38a421-3c6a-42d7-b5ab-ebd157f82330 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:13.471126 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4efb00ff-cf77-4a8f-be26-96116dc17c5b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (7d38a421-3c6a-42d7-b5ab-ebd157f82330), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:13.472977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-4efb00ff-cf77-4a8f-be26-96116dc17c5b admin admin] Security group rule updated ['89d52eba-7e8a-41cf-b307-526f1c6f9c54'] Sep 04 01:05:13.474184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4efb00ff-cf77-4a8f-be26-96116dc17c5b admin admin] Resource SecurityGroupRule deleted: 83164e75-cf0c-4d55-b817-410efecea70a {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:13.477462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4efb00ff-cf77-4a8f-be26-96116dc17c5b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (83164e75-cf0c-4d55-b817-410efecea70a), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:13.477462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-4efb00ff-cf77-4a8f-be26-96116dc17c5b admin admin] Security group rule updated ['89d52eba-7e8a-41cf-b307-526f1c6f9c54'] Sep 04 01:05:13.477462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4efb00ff-cf77-4a8f-be26-96116dc17c5b admin admin] Resource SecurityGroupRule deleted: e2946542-766f-4913-98a8-39d36832b0ad {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:13.477462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4efb00ff-cf77-4a8f-be26-96116dc17c5b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (e2946542-766f-4913-98a8-39d36832b0ad), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:13.477462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-4efb00ff-cf77-4a8f-be26-96116dc17c5b admin admin] Security group rule updated ['89d52eba-7e8a-41cf-b307-526f1c6f9c54'] Sep 04 01:05:13.808443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-1e7a1d68-8473-4121-9db8-30aa6c823259 None None] Resource Port a62a40a2-96f5-427a-808e-9e63c8644245 updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:05:13.809062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-1e7a1d68-8473-4121-9db8-30aa6c823259 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (a62a40a2-96f5-427a-808e-9e63c8644245), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:13.883610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Configuration for devices up ['3c278ab2-dc61-40f8-ab29-c8cc8b740d7d', '0a1a9f7e-73de-4620-ae03-4b1d50d7f706', 'f45b435f-0f64-41fe-a6ec-36683da765f9', '53e7a39c-e9ce-45c4-84af-632f2aac70ae', 'dd44c60a-dd0f-4ff2-85ae-8c012af89cf9'] and devices down [] completed. Sep 04 01:05:13.883944 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:253 - ports processed. Elapsed:8.431 Sep 04 01:05:13.884282 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:253 completed. Processed ports statistics: {'regular': {'added': 3, 'updated': 5, 'removed': 0}}. Elapsed:8.431 Sep 04 01:05:13.885559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Loop iteration exceeded interval (2 vs. 8.430881977081299)! {{(pid=107812) loop_count_and_wait /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2496}} Sep 04 01:05:13.885852 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:254 started Sep 04 01:05:13.888658 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade54db,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=280000000,duration_sec=523,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:05:13.889440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:05:13.890180 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:254 - starting polling. Elapsed:0.004 Sep 04 01:05:13.893037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:13.905777 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:254 - port information retrieved. Elapsed:0.020 Sep 04 01:05:13.906130 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Starting to process devices in:{'current': {'3fa24970-97a7-4f46-ac55-0b24323fa402', '9b82da41-d694-43b0-a43b-5998addaf0bf', '3c278ab2-dc61-40f8-ab29-c8cc8b740d7d', 'a62a40a2-96f5-427a-808e-9e63c8644245', '0a1a9f7e-73de-4620-ae03-4b1d50d7f706', '3045b911-01c5-4fc3-8e89-ac2d9cea12a8', '89aa06b4-bbf1-40c2-bb48-500c3aecdf48', 'f45b435f-0f64-41fe-a6ec-36683da765f9', '53e7a39c-e9ce-45c4-84af-632f2aac70ae', '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', 'dd44c60a-dd0f-4ff2-85ae-8c012af89cf9', '1cf499fb-10a0-4af2-afec-5f610dc85da6', 'ca102ce7-433c-4029-aabf-33d944165ff1'}, 'added': {'1cf499fb-10a0-4af2-afec-5f610dc85da6', '3045b911-01c5-4fc3-8e89-ac2d9cea12a8', 'a62a40a2-96f5-427a-808e-9e63c8644245'}, 'removed': set(), 'updated': {'3045b911-01c5-4fc3-8e89-ac2d9cea12a8', '0a1a9f7e-73de-4620-ae03-4b1d50d7f706', 'f45b435f-0f64-41fe-a6ec-36683da765f9', 'dd44c60a-dd0f-4ff2-85ae-8c012af89cf9', '1cf499fb-10a0-4af2-afec-5f610dc85da6', 'a62a40a2-96f5-427a-808e-9e63c8644245'}, 're_added': set()} {{(pid=107812) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 04 01:05:13.913815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': '3045b911-01c5-4fc3-8e89-ac2d9cea12a8', 'device_id': 'd7fde424-29f8-4dba-95d8-51709b034af5', 'network_id': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'port_id': '3045b911-01c5-4fc3-8e89-ac2d9cea12a8', 'mac_address': 'fa:16:3e:f1:55:69', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '2b17f894-c374-4207-90ad-14f794c86627', 'ip_address': '172.37.7.253'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 01:05:13.914491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': '0a1a9f7e-73de-4620-ae03-4b1d50d7f706', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-d7f39628-666e-4480-8bee-49de183d5e09', 'network_id': 'd7f39628-666e-4480-8bee-49de183d5e09', 'port_id': '0a1a9f7e-73de-4620-ae03-4b1d50d7f706', 'mac_address': 'fa:16:3e:d1:46:c7', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 172, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '1af847f5-eeac-4b3d-afa5-aa099062676b', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 01:05:13.916533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': 'f45b435f-0f64-41fe-a6ec-36683da765f9', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-b16f22e1-6fb1-440b-98eb-845123e960e6', 'network_id': 'b16f22e1-6fb1-440b-98eb-845123e960e6', 'port_id': 'f45b435f-0f64-41fe-a6ec-36683da765f9', 'mac_address': 'fa:16:3e:eb:c4:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 174, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '35ea244b-d6a3-4c9a-a9b3-3f9d2814dee0', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 01:05:13.917225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': 'dd44c60a-dd0f-4ff2-85ae-8c012af89cf9', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-1fb5aed8-696d-4f87-8b2a-7d29744538a8', 'network_id': '1fb5aed8-696d-4f87-8b2a-7d29744538a8', 'port_id': 'dd44c60a-dd0f-4ff2-85ae-8c012af89cf9', 'mac_address': 'fa:16:3e:6f:ff:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 193, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'cf87fd90-4193-4f02-8ccd-ce8ccea66ca5', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 01:05:13.919674 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': '1cf499fb-10a0-4af2-afec-5f610dc85da6', 'device_id': 'e4262b22-bfcc-4362-b0da-5c283cfb2e9a', 'network_id': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'port_id': '1cf499fb-10a0-4af2-afec-5f610dc85da6', 'mac_address': 'fa:16:3e:8a:3e:25', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '2b17f894-c374-4207-90ad-14f794c86627', 'ip_address': '172.37.7.55'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 01:05:13.920324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': 'a62a40a2-96f5-427a-808e-9e63c8644245', 'device_id': 'a8e13541-9272-4fa2-a9ff-940907d6ba01', 'network_id': '3b7528ba-1624-4915-b635-aeb0700ea8e7', 'port_id': 'a62a40a2-96f5-427a-808e-9e63c8644245', 'mac_address': 'fa:16:3e:dd:cb:78', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 158, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '46f76b48-bc1e-4bf9-b91c-49408437f259', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 01:05:13.925906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: 3045b911-01c5-4fc3-8e89-ac2d9cea12a8 {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:05:13.926281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 3045b911-01c5-4fc3-8e89-ac2d9cea12a8 updated. Details: {'device': '3045b911-01c5-4fc3-8e89-ac2d9cea12a8', 'device_id': 'd7fde424-29f8-4dba-95d8-51709b034af5', 'network_id': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'port_id': '3045b911-01c5-4fc3-8e89-ac2d9cea12a8', 'mac_address': 'fa:16:3e:f1:55:69', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '2b17f894-c374-4207-90ad-14f794c86627', 'ip_address': '172.37.7.253'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 04 01:05:13.939359 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-3045b911-01, col_values=(('tag', 2),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:13.950814 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-3045b911-01, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:13.950814 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-3045b911-01, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:13.967393 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-d864986a-44e5-42f1-bf82-dff3ac84c6c4 admin admin] Received resource Port update without any changes: a6788698-0516-4d8a-8fe8-2add6e7f6e94 {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:181}} Sep 04 01:05:13.983188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-3045b911-01, col_values=(('other_config', {'net_uuid': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:14.030883 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade54dd,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 14}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:05:14.031347 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: 0a1a9f7e-73de-4620-ae03-4b1d50d7f706 {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:05:14.031606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 0a1a9f7e-73de-4620-ae03-4b1d50d7f706 updated. Details: {'device': '0a1a9f7e-73de-4620-ae03-4b1d50d7f706', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-d7f39628-666e-4480-8bee-49de183d5e09', 'network_id': 'd7f39628-666e-4480-8bee-49de183d5e09', 'port_id': '0a1a9f7e-73de-4620-ae03-4b1d50d7f706', 'mac_address': 'fa:16:3e:d1:46:c7', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 172, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '1af847f5-eeac-4b3d-afa5-aa099062676b', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 6} Sep 04 01:05:14.033303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap0a1a9f7e-73, col_values=(('tag', 6),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:14.033427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap0a1a9f7e-73, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:14.033781 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap0a1a9f7e-73, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:14.034237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 01:05:14.054631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap0a1a9f7e-73, col_values=(('other_config', {'net_uuid': 'd7f39628-666e-4480-8bee-49de183d5e09', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '172', 'tag': '6'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:14.055729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 01:05:14.070366 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade54df,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 11}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:05:14.070747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: f45b435f-0f64-41fe-a6ec-36683da765f9 {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:05:14.076616 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port f45b435f-0f64-41fe-a6ec-36683da765f9 updated. Details: {'device': 'f45b435f-0f64-41fe-a6ec-36683da765f9', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-b16f22e1-6fb1-440b-98eb-845123e960e6', 'network_id': 'b16f22e1-6fb1-440b-98eb-845123e960e6', 'port_id': 'f45b435f-0f64-41fe-a6ec-36683da765f9', 'mac_address': 'fa:16:3e:eb:c4:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 174, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '35ea244b-d6a3-4c9a-a9b3-3f9d2814dee0', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 7} Sep 04 01:05:14.078366 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapf45b435f-0f, col_values=(('tag', 7),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:14.080256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tapf45b435f-0f, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:14.082726 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tapf45b435f-0f, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:14.085382 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 01:05:14.099479 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapf45b435f-0f, col_values=(('other_config', {'net_uuid': 'b16f22e1-6fb1-440b-98eb-845123e960e6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '174', 'tag': '7'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:14.102993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 01:05:14.108236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade54e1,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 10}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:05:14.109401 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: dd44c60a-dd0f-4ff2-85ae-8c012af89cf9 {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:05:14.109903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port dd44c60a-dd0f-4ff2-85ae-8c012af89cf9 updated. Details: {'device': 'dd44c60a-dd0f-4ff2-85ae-8c012af89cf9', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-1fb5aed8-696d-4f87-8b2a-7d29744538a8', 'network_id': '1fb5aed8-696d-4f87-8b2a-7d29744538a8', 'port_id': 'dd44c60a-dd0f-4ff2-85ae-8c012af89cf9', 'mac_address': 'fa:16:3e:6f:ff:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 193, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'cf87fd90-4193-4f02-8ccd-ce8ccea66ca5', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 8} Sep 04 01:05:14.112589 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapdd44c60a-dd, col_values=(('tag', 8),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:14.113204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tapdd44c60a-dd, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:14.114888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tapdd44c60a-dd, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:14.115660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 01:05:14.116613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapdd44c60a-dd, col_values=(('other_config', {'net_uuid': '1fb5aed8-696d-4f87-8b2a-7d29744538a8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '193', 'tag': '8'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:14.117856 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 01:05:14.137665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade54e3,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 9}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:05:14.138198 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: 1cf499fb-10a0-4af2-afec-5f610dc85da6 {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:05:14.138689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 1cf499fb-10a0-4af2-afec-5f610dc85da6 updated. Details: {'device': '1cf499fb-10a0-4af2-afec-5f610dc85da6', 'device_id': 'e4262b22-bfcc-4362-b0da-5c283cfb2e9a', 'network_id': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'port_id': '1cf499fb-10a0-4af2-afec-5f610dc85da6', 'mac_address': 'fa:16:3e:8a:3e:25', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '2b17f894-c374-4207-90ad-14f794c86627', 'ip_address': '172.37.7.55'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 04 01:05:14.148026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-1cf499fb-10, col_values=(('tag', 2),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:14.148773 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-1cf499fb-10, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:14.149402 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-1cf499fb-10, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:14.172430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-1cf499fb-10, col_values=(('other_config', {'net_uuid': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:14.202279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade54e5,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 12}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:05:14.202687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: a62a40a2-96f5-427a-808e-9e63c8644245 {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:05:14.203023 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port a62a40a2-96f5-427a-808e-9e63c8644245 updated. Details: {'device': 'a62a40a2-96f5-427a-808e-9e63c8644245', 'device_id': 'a8e13541-9272-4fa2-a9ff-940907d6ba01', 'network_id': '3b7528ba-1624-4915-b635-aeb0700ea8e7', 'port_id': 'a62a40a2-96f5-427a-808e-9e63c8644245', 'mac_address': 'fa:16:3e:dd:cb:78', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 158, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '46f76b48-bc1e-4bf9-b91c-49408437f259', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 4} Sep 04 01:05:14.204702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-a62a40a2-96, col_values=(('tag', 4),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:14.204702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-a62a40a2-96, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:14.204972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-a62a40a2-96, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:14.222806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-a62a40a2-96, col_values=(('other_config', {'net_uuid': '3b7528ba-1624-4915-b635-aeb0700ea8e7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '4', 'segmentation_id': '158'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:14.252001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade54e7,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 13}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:05:14.254152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:254 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 13 devices currently available. Time elapsed: 0.346 Sep 04 01:05:14.257231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Preparing device filters for 3 new devices {{(pid=107812) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 04 01:05:14.257564 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Preparing filters for devices {'1cf499fb-10a0-4af2-afec-5f610dc85da6', '3045b911-01c5-4fc3-8e89-ac2d9cea12a8', 'a62a40a2-96f5-427a-808e-9e63c8644245'} Sep 04 01:05:14.265440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information for ports dict_keys([]) {{(pid=107812) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 04 01:05:14.265769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information {{(pid=107812) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 04 01:05:14.290375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 6 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:05:14.376694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[921b626a-afb9-4894-b32a-af12e56973b6]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:05:14.377361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Refreshing firewall for 3 devices {{(pid=107812) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 04 01:05:14.377661 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Refresh firewall rules Sep 04 01:05:14.380105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information for ports dict_keys([]) {{(pid=107812) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 04 01:05:14.380484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information {{(pid=107812) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 04 01:05:14.385812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 6 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:05:14.508816 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2143b5-49fb-425c-96f8-194c1836d80b]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:05:14.509515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:254 - agent port security group processed in 0.603 Sep 04 01:05:14.510559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for 3045b911-01c5-4fc3-8e89-ac2d9cea12a8 to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 01:05:14.511171 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for 0a1a9f7e-73de-4620-ae03-4b1d50d7f706 to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 01:05:14.511472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for f45b435f-0f64-41fe-a6ec-36683da765f9 to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 01:05:14.511758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for dd44c60a-dd0f-4ff2-85ae-8c012af89cf9 to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 01:05:14.512282 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for 1cf499fb-10a0-4af2-afec-5f610dc85da6 to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 01:05:14.512732 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for a62a40a2-96f5-427a-808e-9e63c8644245 to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 01:05:14.857281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-72dcff8d-385a-4071-9c9f-708b434cee65 None None] Resource Port 6771cbc4-3e4b-419f-b87f-2db662f6e010 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=6771cbc4-3e4b-419f-b87f-2db662f6e010,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=6771cbc4-3e4b-419f-b87f-2db662f6e010,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:05:14.857662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-72dcff8d-385a-4071-9c9f-708b434cee65 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (6771cbc4-3e4b-419f-b87f-2db662f6e010), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:15.043482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["21f182fa-e000-4708-8306-2f02a75e38ed","insert","qg-4ed942cd-0f",["set",[]],["map",[["attached-mac","fa:16:3e:0e:53:5a"],["iface-id","4ed942cd-0f45-4d77-a66d-1d6c875877dc"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:05:15.088608 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["21f182fa-e000-4708-8306-2f02a75e38ed","old",null,["set",[]],null],["","new","qg-4ed942cd-0f",15,["map",[["attached-mac","fa:16:3e:0e:53:5a"],["iface-id","4ed942cd-0f45-4d77-a66d-1d6c875877dc"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:05:15.451028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-02d41161-0f4b-4bd2-b654-4a547cd3c3a3 tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:05:14Z,description='tempest-description--1400333823',id=2a5bcd08-2f5c-4785-8968-f136b0051d59,is_default=False,name='tempest-securitygroup--98131319',project_id='e7dca68418a14d7da9aa63ac25f202e8',revision_number=1,rules=[SecurityGroupRule(8951d6af-0c63-4ed3-b500-c6b9455c4528),SecurityGroupRule(edc26496-84fe-4696-9782-78e7aee897c2)],shared=False,stateful=True,updated_at=2022-09-04T01:05:14Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:15.451731 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-02d41161-0f4b-4bd2-b654-4a547cd3c3a3 tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (2a5bcd08-2f5c-4785-8968-f136b0051d59), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:15.452072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-02d41161-0f4b-4bd2-b654-4a547cd3c3a3 tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:05:14Z,description=,direction='egress',ethertype='IPv4',id=8951d6af-0c63-4ed3-b500-c6b9455c4528,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e7dca68418a14d7da9aa63ac25f202e8',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2a5bcd08-2f5c-4785-8968-f136b0051d59,updated_at=2022-09-04T01:05:14Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:15.452432 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-02d41161-0f4b-4bd2-b654-4a547cd3c3a3 tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (8951d6af-0c63-4ed3-b500-c6b9455c4528), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:15.452769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-02d41161-0f4b-4bd2-b654-4a547cd3c3a3 tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Security group rule updated ['2a5bcd08-2f5c-4785-8968-f136b0051d59'] Sep 04 01:05:15.465724 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-02d41161-0f4b-4bd2-b654-4a547cd3c3a3 tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:05:14Z,description=,direction='egress',ethertype='IPv6',id=edc26496-84fe-4696-9782-78e7aee897c2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e7dca68418a14d7da9aa63ac25f202e8',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2a5bcd08-2f5c-4785-8968-f136b0051d59,updated_at=2022-09-04T01:05:14Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:15.466370 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-02d41161-0f4b-4bd2-b654-4a547cd3c3a3 tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (edc26496-84fe-4696-9782-78e7aee897c2), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:15.466866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-02d41161-0f4b-4bd2-b654-4a547cd3c3a3 tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Security group rule updated ['2a5bcd08-2f5c-4785-8968-f136b0051d59'] Sep 04 01:05:15.572098 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-39357af2-03b0-48c2-a6e9-8adcd02e68a6 admin admin] Received resource Port update without any changes: f38c3884-111a-49d9-bcf1-6a965ff5e110 {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:181}} Sep 04 01:05:15.587519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b8c5284d-a4b1-4443-b6be-2fc711b86e86 admin admin] Resource SecurityGroup deleted: 8f0bcf6f-cf3f-4eea-8ce8-5f46f2c8f075 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:15.588186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b8c5284d-a4b1-4443-b6be-2fc711b86e86 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (8f0bcf6f-cf3f-4eea-8ce8-5f46f2c8f075), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:15.588797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8c5284d-a4b1-4443-b6be-2fc711b86e86 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('8f0bcf6f-cf3f-4eea-8ce8-5f46f2c8f075',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:05:15.620936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-72dcff8d-385a-4071-9c9f-708b434cee65 None None] Resource Port 6771cbc4-3e4b-419f-b87f-2db662f6e010 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=6771cbc4-3e4b-419f-b87f-2db662f6e010,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=6771cbc4-3e4b-419f-b87f-2db662f6e010,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=6771cbc4-3e4b-419f-b87f-2db662f6e010,segment=NetworkSegment(c26850af-ca47-4ea8-9a33-a34f3381800e),segment_id=c26850af-ca47-4ea8-9a33-a34f3381800e)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:05:15.621662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-72dcff8d-385a-4071-9c9f-708b434cee65 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (6771cbc4-3e4b-419f-b87f-2db662f6e010), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:15.744456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b8c5284d-a4b1-4443-b6be-2fc711b86e86 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('8f0bcf6f-cf3f-4eea-8ce8-5f46f2c8f075',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:05:15.744912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b8c5284d-a4b1-4443-b6be-2fc711b86e86 admin admin] Resource SecurityGroupRule deleted: 15633227-d474-48e2-ad05-506e851efa16 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:15.745320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b8c5284d-a4b1-4443-b6be-2fc711b86e86 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (15633227-d474-48e2-ad05-506e851efa16), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:15.745655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-b8c5284d-a4b1-4443-b6be-2fc711b86e86 admin admin] Security group rule updated ['8f0bcf6f-cf3f-4eea-8ce8-5f46f2c8f075'] Sep 04 01:05:15.746095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b8c5284d-a4b1-4443-b6be-2fc711b86e86 admin admin] Resource SecurityGroupRule deleted: 1ef89f9e-ee54-43e2-b995-c681e03917ef {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:15.746439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b8c5284d-a4b1-4443-b6be-2fc711b86e86 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (1ef89f9e-ee54-43e2-b995-c681e03917ef), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:15.746758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-b8c5284d-a4b1-4443-b6be-2fc711b86e86 admin admin] Security group rule updated ['8f0bcf6f-cf3f-4eea-8ce8-5f46f2c8f075'] Sep 04 01:05:15.747173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b8c5284d-a4b1-4443-b6be-2fc711b86e86 admin admin] Resource SecurityGroupRule deleted: 319d97a7-aad0-46af-b309-25b5a263ef40 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:15.747512 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b8c5284d-a4b1-4443-b6be-2fc711b86e86 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (319d97a7-aad0-46af-b309-25b5a263ef40), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:15.747825 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-b8c5284d-a4b1-4443-b6be-2fc711b86e86 admin admin] Security group rule updated ['8f0bcf6f-cf3f-4eea-8ce8-5f46f2c8f075'] Sep 04 01:05:15.748237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b8c5284d-a4b1-4443-b6be-2fc711b86e86 admin admin] Resource SecurityGroupRule deleted: 3dbc66b5-23e0-4edc-a054-94ac38222dd4 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:15.748585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b8c5284d-a4b1-4443-b6be-2fc711b86e86 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (3dbc66b5-23e0-4edc-a054-94ac38222dd4), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:15.748882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-b8c5284d-a4b1-4443-b6be-2fc711b86e86 admin admin] Security group rule updated ['8f0bcf6f-cf3f-4eea-8ce8-5f46f2c8f075'] Sep 04 01:05:15.966256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-62e7c04a-ba48-4b78-ab0b-dbf9d9862eb9 tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:05:15Z,description='',direction='ingress',ethertype='IPv4',id=62d9be9f-d0f8-4a14-9fce-32fa8406bf4f,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='e7dca68418a14d7da9aa63ac25f202e8',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2a5bcd08-2f5c-4785-8968-f136b0051d59,updated_at=2022-09-04T01:05:15Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:15.969763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-62e7c04a-ba48-4b78-ab0b-dbf9d9862eb9 tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (62d9be9f-d0f8-4a14-9fce-32fa8406bf4f), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:15.969763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-62e7c04a-ba48-4b78-ab0b-dbf9d9862eb9 tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Security group rule updated ['2a5bcd08-2f5c-4785-8968-f136b0051d59'] Sep 04 01:05:16.065487 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Resource Port 3045b911-01c5-4fc3-8e89-ac2d9cea12a8 updated (revision_number 3->4). Old fields: {'status': 'DOWN', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=3045b911-01c5-4fc3-8e89-ac2d9cea12a8,segment=NetworkSegment(c26850af-ca47-4ea8-9a33-a34f3381800e),segment_id=c26850af-ca47-4ea8-9a33-a34f3381800e)]} New fields: {'status': 'ACTIVE', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=3045b911-01c5-4fc3-8e89-ac2d9cea12a8,segment=NetworkSegment(c26850af-ca47-4ea8-9a33-a34f3381800e),segment_id=c26850af-ca47-4ea8-9a33-a34f3381800e)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:05:16.065874 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (3045b911-01c5-4fc3-8e89-ac2d9cea12a8), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:16.494958 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-59678fe9-eac1-4704-8342-59d4171e0e35 None None] Resource Port c2f724af-5dbd-4d91-83cd-c5152b744599 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=c2f724af-5dbd-4d91-83cd-c5152b744599,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=c2f724af-5dbd-4d91-83cd-c5152b744599,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:05:16.495635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-59678fe9-eac1-4704-8342-59d4171e0e35 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (c2f724af-5dbd-4d91-83cd-c5152b744599), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:17.915994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-16d14e6f-3385-4c5d-ae0a-7a9cbf6d724d admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:05:15Z,description='Default security group',id=2106cba1-5a7c-45be-9f79-24604230d2cc,is_default=True,name='default',project_id='2b4087f305b5468b973de4fe953bee24',revision_number=1,rules=[SecurityGroupRule(10cff962-d027-44ba-8eb0-96baf1ef7e2a),SecurityGroupRule(65af846a-ec17-4436-b7eb-740fc263e43e),SecurityGroupRule(7644d6bc-a56a-4a32-82a2-52a0ee316452),SecurityGroupRule(fb702310-cd91-447e-b1fd-ce211ace0562)],shared=False,stateful=True,updated_at=2022-09-04T01:05:16Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:17.917057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-16d14e6f-3385-4c5d-ae0a-7a9cbf6d724d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (2106cba1-5a7c-45be-9f79-24604230d2cc), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:17.918142 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-16d14e6f-3385-4c5d-ae0a-7a9cbf6d724d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:05:16Z,description=,direction='egress',ethertype='IPv6',id=10cff962-d027-44ba-8eb0-96baf1ef7e2a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2b4087f305b5468b973de4fe953bee24',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2106cba1-5a7c-45be-9f79-24604230d2cc,updated_at=2022-09-04T01:05:16Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:17.918767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-16d14e6f-3385-4c5d-ae0a-7a9cbf6d724d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (10cff962-d027-44ba-8eb0-96baf1ef7e2a), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:17.919242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-16d14e6f-3385-4c5d-ae0a-7a9cbf6d724d admin admin] Security group rule updated ['2106cba1-5a7c-45be-9f79-24604230d2cc'] Sep 04 01:05:17.920209 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-16d14e6f-3385-4c5d-ae0a-7a9cbf6d724d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:05:16Z,description=,direction='ingress',ethertype='IPv6',id=65af846a-ec17-4436-b7eb-740fc263e43e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2b4087f305b5468b973de4fe953bee24',protocol=,remote_address_group_id=,remote_group_id=2106cba1-5a7c-45be-9f79-24604230d2cc,remote_ip_prefix=,revision_number=0,security_group_id=2106cba1-5a7c-45be-9f79-24604230d2cc,updated_at=2022-09-04T01:05:16Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:17.920722 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-16d14e6f-3385-4c5d-ae0a-7a9cbf6d724d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (65af846a-ec17-4436-b7eb-740fc263e43e), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:17.921407 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-16d14e6f-3385-4c5d-ae0a-7a9cbf6d724d admin admin] Security group rule updated ['2106cba1-5a7c-45be-9f79-24604230d2cc'] Sep 04 01:05:17.922254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-16d14e6f-3385-4c5d-ae0a-7a9cbf6d724d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:05:16Z,description=,direction='ingress',ethertype='IPv4',id=7644d6bc-a56a-4a32-82a2-52a0ee316452,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2b4087f305b5468b973de4fe953bee24',protocol=,remote_address_group_id=,remote_group_id=2106cba1-5a7c-45be-9f79-24604230d2cc,remote_ip_prefix=,revision_number=0,security_group_id=2106cba1-5a7c-45be-9f79-24604230d2cc,updated_at=2022-09-04T01:05:16Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:17.923777 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-16d14e6f-3385-4c5d-ae0a-7a9cbf6d724d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (7644d6bc-a56a-4a32-82a2-52a0ee316452), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:17.929708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-16d14e6f-3385-4c5d-ae0a-7a9cbf6d724d admin admin] Security group rule updated ['2106cba1-5a7c-45be-9f79-24604230d2cc'] Sep 04 01:05:17.929708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-16d14e6f-3385-4c5d-ae0a-7a9cbf6d724d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:05:16Z,description=,direction='egress',ethertype='IPv4',id=fb702310-cd91-447e-b1fd-ce211ace0562,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2b4087f305b5468b973de4fe953bee24',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2106cba1-5a7c-45be-9f79-24604230d2cc,updated_at=2022-09-04T01:05:16Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:17.929708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-16d14e6f-3385-4c5d-ae0a-7a9cbf6d724d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (fb702310-cd91-447e-b1fd-ce211ace0562), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:17.929708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-16d14e6f-3385-4c5d-ae0a-7a9cbf6d724d admin admin] Security group rule updated ['2106cba1-5a7c-45be-9f79-24604230d2cc'] Sep 04 01:05:18.091133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-59678fe9-eac1-4704-8342-59d4171e0e35 None None] Resource Port c2f724af-5dbd-4d91-83cd-c5152b744599 updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=c2f724af-5dbd-4d91-83cd-c5152b744599,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=c2f724af-5dbd-4d91-83cd-c5152b744599,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=c2f724af-5dbd-4d91-83cd-c5152b744599,segment=NetworkSegment(294bd754-f77e-4dd5-a8a8-fa66c41ba024),segment_id=294bd754-f77e-4dd5-a8a8-fa66c41ba024)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:05:18.091908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-59678fe9-eac1-4704-8342-59d4171e0e35 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (c2f724af-5dbd-4d91-83cd-c5152b744599), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:18.130753 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-295c2cc6-64ac-4bc7-b627-6a18fb216295 tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:05:16Z,description='tempest-description--1863802320',id=28889e15-3fb7-44d1-a902-1d3272393b5a,is_default=False,name='tempest-securitygroup--385291614',project_id='55faed42b7f243df9df879d581797f56',revision_number=1,rules=[SecurityGroupRule(4cd47fc4-9c7e-4882-8e3e-890204bcb3f6),SecurityGroupRule(f32a7105-39c6-4376-9e61-df74bc738a43)],shared=False,stateful=True,updated_at=2022-09-04T01:05:16Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:18.131421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-295c2cc6-64ac-4bc7-b627-6a18fb216295 tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (28889e15-3fb7-44d1-a902-1d3272393b5a), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:18.132174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-295c2cc6-64ac-4bc7-b627-6a18fb216295 tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:05:16Z,description=,direction='egress',ethertype='IPv4',id=4cd47fc4-9c7e-4882-8e3e-890204bcb3f6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='55faed42b7f243df9df879d581797f56',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=28889e15-3fb7-44d1-a902-1d3272393b5a,updated_at=2022-09-04T01:05:16Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:18.132702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-295c2cc6-64ac-4bc7-b627-6a18fb216295 tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (4cd47fc4-9c7e-4882-8e3e-890204bcb3f6), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:18.133477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-295c2cc6-64ac-4bc7-b627-6a18fb216295 tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Security group rule updated ['28889e15-3fb7-44d1-a902-1d3272393b5a'] Sep 04 01:05:18.134593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-295c2cc6-64ac-4bc7-b627-6a18fb216295 tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:05:16Z,description=,direction='egress',ethertype='IPv6',id=f32a7105-39c6-4376-9e61-df74bc738a43,normalized_cidr=None,port_range_max=,port_range_min=,project_id='55faed42b7f243df9df879d581797f56',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=28889e15-3fb7-44d1-a902-1d3272393b5a,updated_at=2022-09-04T01:05:16Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:18.135069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-295c2cc6-64ac-4bc7-b627-6a18fb216295 tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (f32a7105-39c6-4376-9e61-df74bc738a43), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:18.135572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-295c2cc6-64ac-4bc7-b627-6a18fb216295 tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Security group rule updated ['28889e15-3fb7-44d1-a902-1d3272393b5a'] Sep 04 01:05:18.228517 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-fd38a51d-986e-4ed3-a376-48658ac8cd6d tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:05:17Z,description='',direction='ingress',ethertype='IPv4',id=cba7c2a1-55d9-479e-8432-5120b17f428d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e7dca68418a14d7da9aa63ac25f202e8',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2a5bcd08-2f5c-4785-8968-f136b0051d59,updated_at=2022-09-04T01:05:17Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:18.228517 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-fd38a51d-986e-4ed3-a376-48658ac8cd6d tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (cba7c2a1-55d9-479e-8432-5120b17f428d), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:18.228517 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-fd38a51d-986e-4ed3-a376-48658ac8cd6d tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Security group rule updated ['2a5bcd08-2f5c-4785-8968-f136b0051d59'] Sep 04 01:05:18.262743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["0dce06b8-3668-4e59-a593-1c7220ba03f7","insert","qr-f38c3884-11",["set",[]],["map",[["attached-mac","fa:16:3e:62:0b:90"],["iface-id","f38c3884-111a-49d9-bcf1-6a965ff5e110"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:05:18.313668 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["0dce06b8-3668-4e59-a593-1c7220ba03f7","old",null,["set",[]],null],["","new","qr-f38c3884-11",16,["map",[["attached-mac","fa:16:3e:62:0b:90"],["iface-id","f38c3884-111a-49d9-bcf1-6a965ff5e110"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:05:18.351960 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Resource Port 1cf499fb-10a0-4af2-afec-5f610dc85da6 updated (revision_number 3->4). Old fields: {'status': 'DOWN', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=1cf499fb-10a0-4af2-afec-5f610dc85da6,segment=NetworkSegment(c26850af-ca47-4ea8-9a33-a34f3381800e),segment_id=c26850af-ca47-4ea8-9a33-a34f3381800e)]} New fields: {'status': 'ACTIVE', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=1cf499fb-10a0-4af2-afec-5f610dc85da6,segment=NetworkSegment(c26850af-ca47-4ea8-9a33-a34f3381800e),segment_id=c26850af-ca47-4ea8-9a33-a34f3381800e)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:05:18.352380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (1cf499fb-10a0-4af2-afec-5f610dc85da6), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:18.410833 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4272218f-b884-480e-8fcf-6d5e63a597f2 None None] Resource Port 378bbdd4-3077-4657-8055-fdc0a7600948 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=378bbdd4-3077-4657-8055-fdc0a7600948,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=378bbdd4-3077-4657-8055-fdc0a7600948,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:05:18.411907 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4272218f-b884-480e-8fcf-6d5e63a597f2 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (378bbdd4-3077-4657-8055-fdc0a7600948), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:18.764698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-8bbaab0e-72ec-41af-ad70-0cf3d36b8ad2 admin admin] Resource SecurityGroup deleted: 2106cba1-5a7c-45be-9f79-24604230d2cc {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:18.765232 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-8bbaab0e-72ec-41af-ad70-0cf3d36b8ad2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (2106cba1-5a7c-45be-9f79-24604230d2cc), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:18.765801 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8bbaab0e-72ec-41af-ad70-0cf3d36b8ad2 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('2106cba1-5a7c-45be-9f79-24604230d2cc',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:05:18.832973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-8bbaab0e-72ec-41af-ad70-0cf3d36b8ad2 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('2106cba1-5a7c-45be-9f79-24604230d2cc',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:05:18.833560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-8bbaab0e-72ec-41af-ad70-0cf3d36b8ad2 admin admin] Resource SecurityGroupRule deleted: 10cff962-d027-44ba-8eb0-96baf1ef7e2a {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:18.834169 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-8bbaab0e-72ec-41af-ad70-0cf3d36b8ad2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (10cff962-d027-44ba-8eb0-96baf1ef7e2a), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:18.835300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-8bbaab0e-72ec-41af-ad70-0cf3d36b8ad2 admin admin] Security group rule updated ['2106cba1-5a7c-45be-9f79-24604230d2cc'] Sep 04 01:05:18.835926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-8bbaab0e-72ec-41af-ad70-0cf3d36b8ad2 admin admin] Resource SecurityGroupRule deleted: 65af846a-ec17-4436-b7eb-740fc263e43e {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:18.836378 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-8bbaab0e-72ec-41af-ad70-0cf3d36b8ad2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (65af846a-ec17-4436-b7eb-740fc263e43e), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:18.836797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-8bbaab0e-72ec-41af-ad70-0cf3d36b8ad2 admin admin] Security group rule updated ['2106cba1-5a7c-45be-9f79-24604230d2cc'] Sep 04 01:05:18.837405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-8bbaab0e-72ec-41af-ad70-0cf3d36b8ad2 admin admin] Resource SecurityGroupRule deleted: 7644d6bc-a56a-4a32-82a2-52a0ee316452 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:18.837920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-8bbaab0e-72ec-41af-ad70-0cf3d36b8ad2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (7644d6bc-a56a-4a32-82a2-52a0ee316452), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:18.838333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-8bbaab0e-72ec-41af-ad70-0cf3d36b8ad2 admin admin] Security group rule updated ['2106cba1-5a7c-45be-9f79-24604230d2cc'] Sep 04 01:05:18.841173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-8bbaab0e-72ec-41af-ad70-0cf3d36b8ad2 admin admin] Resource SecurityGroupRule deleted: fb702310-cd91-447e-b1fd-ce211ace0562 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:18.845167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-8bbaab0e-72ec-41af-ad70-0cf3d36b8ad2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (fb702310-cd91-447e-b1fd-ce211ace0562), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:18.845167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-8bbaab0e-72ec-41af-ad70-0cf3d36b8ad2 admin admin] Security group rule updated ['2106cba1-5a7c-45be-9f79-24604230d2cc'] Sep 04 01:05:18.847008 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Configuration for devices up ['3045b911-01c5-4fc3-8e89-ac2d9cea12a8', '0a1a9f7e-73de-4620-ae03-4b1d50d7f706', 'f45b435f-0f64-41fe-a6ec-36683da765f9', 'dd44c60a-dd0f-4ff2-85ae-8c012af89cf9', '1cf499fb-10a0-4af2-afec-5f610dc85da6', 'a62a40a2-96f5-427a-808e-9e63c8644245'] and devices down [] completed. Sep 04 01:05:18.849527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:254 - ports processed. Elapsed:4.961 Sep 04 01:05:18.850319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:254 completed. Processed ports statistics: {'regular': {'added': 3, 'updated': 6, 'removed': 0}}. Elapsed:4.964 Sep 04 01:05:18.851601 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Loop iteration exceeded interval (2 vs. 4.964425086975098)! {{(pid=107812) loop_count_and_wait /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2496}} Sep 04 01:05:18.853803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:255 started Sep 04 01:05:18.864419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade54e9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=251000000,duration_sec=528,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:05:18.885610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:05:18.885610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:255 - starting polling. Elapsed:0.012 Sep 04 01:05:18.885610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:18.885610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:255 - port information retrieved. Elapsed:0.017 Sep 04 01:05:18.886554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Starting to process devices in:{'current': {'3fa24970-97a7-4f46-ac55-0b24323fa402', '9b82da41-d694-43b0-a43b-5998addaf0bf', '3c278ab2-dc61-40f8-ab29-c8cc8b740d7d', 'a62a40a2-96f5-427a-808e-9e63c8644245', '0a1a9f7e-73de-4620-ae03-4b1d50d7f706', '3045b911-01c5-4fc3-8e89-ac2d9cea12a8', '89aa06b4-bbf1-40c2-bb48-500c3aecdf48', 'f38c3884-111a-49d9-bcf1-6a965ff5e110', '4ed942cd-0f45-4d77-a66d-1d6c875877dc', 'f45b435f-0f64-41fe-a6ec-36683da765f9', '53e7a39c-e9ce-45c4-84af-632f2aac70ae', '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', 'dd44c60a-dd0f-4ff2-85ae-8c012af89cf9', '1cf499fb-10a0-4af2-afec-5f610dc85da6', 'ca102ce7-433c-4029-aabf-33d944165ff1'}, 'added': {'f38c3884-111a-49d9-bcf1-6a965ff5e110', '4ed942cd-0f45-4d77-a66d-1d6c875877dc'}, 'removed': set(), 'updated': {'1cf499fb-10a0-4af2-afec-5f610dc85da6', '3045b911-01c5-4fc3-8e89-ac2d9cea12a8'}, 're_added': set()} {{(pid=107812) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 04 01:05:18.887295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': '1cf499fb-10a0-4af2-afec-5f610dc85da6', 'device_id': 'e4262b22-bfcc-4362-b0da-5c283cfb2e9a', 'network_id': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'port_id': '1cf499fb-10a0-4af2-afec-5f610dc85da6', 'mac_address': 'fa:16:3e:8a:3e:25', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '2b17f894-c374-4207-90ad-14f794c86627', 'ip_address': '172.37.7.55'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 01:05:18.887295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: WARNING neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Device Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:05:11Z,data_plane_status=None,description='',device_id='61883c33-5f31-4a53-b117-0fe975bce512',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=f38c3884-111a-49d9-bcf1-6a965ff5e110,mac_address=fa:16:3e:62:0b:90,name='',network_id=b16f22e1-6fb1-440b-98eb-845123e960e6,numa_affinity_policy=,project_id='db72b63281384bd883b04d05bcc35677',qos_network_policy_id=None,qos_policy_id=None,revision_number=2,security=PortSecurity(f38c3884-111a-49d9-bcf1-6a965ff5e110),security_group_ids=set([]),status='DOWN',updated_at=2022-09-04T01:05:14Z) is not bound. Sep 04 01:05:18.887713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': '4ed942cd-0f45-4d77-a66d-1d6c875877dc', 'device_id': 'a6875d57-1898-4fcc-8186-5995078e83c1', 'network_id': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'port_id': '4ed942cd-0f45-4d77-a66d-1d6c875877dc', 'mac_address': 'fa:16:3e:0e:53:5a', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '2b17f894-c374-4207-90ad-14f794c86627', 'ip_address': '172.37.7.166'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 01:05:18.887713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': '3045b911-01c5-4fc3-8e89-ac2d9cea12a8', 'device_id': 'd7fde424-29f8-4dba-95d8-51709b034af5', 'network_id': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'port_id': '3045b911-01c5-4fc3-8e89-ac2d9cea12a8', 'mac_address': 'fa:16:3e:f1:55:69', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '2b17f894-c374-4207-90ad-14f794c86627', 'ip_address': '172.37.7.253'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 01:05:18.892106 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: 1cf499fb-10a0-4af2-afec-5f610dc85da6 {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:05:18.892575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 1cf499fb-10a0-4af2-afec-5f610dc85da6 updated. Details: {'device': '1cf499fb-10a0-4af2-afec-5f610dc85da6', 'device_id': 'e4262b22-bfcc-4362-b0da-5c283cfb2e9a', 'network_id': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'port_id': '1cf499fb-10a0-4af2-afec-5f610dc85da6', 'mac_address': 'fa:16:3e:8a:3e:25', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '2b17f894-c374-4207-90ad-14f794c86627', 'ip_address': '172.37.7.55'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 04 01:05:18.901376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-1cf499fb-10, col_values=(('tag', 2),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:18.908314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-1cf499fb-10, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:18.908314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-1cf499fb-10, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:18.908314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 01:05:18.908314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-1cf499fb-10, col_values=(('other_config', {'net_uuid': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:18.908314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 01:05:18.909645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade54eb,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 12}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:05:18.915559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: f38c3884-111a-49d9-bcf1-6a965ff5e110 {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:05:18.916031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: WARNING neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Device f38c3884-111a-49d9-bcf1-6a965ff5e110 not defined on plugin or binding failed Sep 04 01:05:18.916843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: 4ed942cd-0f45-4d77-a66d-1d6c875877dc {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:05:18.917147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 4ed942cd-0f45-4d77-a66d-1d6c875877dc updated. Details: {'device': '4ed942cd-0f45-4d77-a66d-1d6c875877dc', 'device_id': 'a6875d57-1898-4fcc-8186-5995078e83c1', 'network_id': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'port_id': '4ed942cd-0f45-4d77-a66d-1d6c875877dc', 'mac_address': 'fa:16:3e:0e:53:5a', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '2b17f894-c374-4207-90ad-14f794c86627', 'ip_address': '172.37.7.166'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 04 01:05:18.918496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-4ed942cd-0f, col_values=(('tag', 2),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:18.925136 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-4ed942cd-0f, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:18.925136 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-4ed942cd-0f, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:18.937598 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-4ed942cd-0f, col_values=(('other_config', {'net_uuid': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:18.954083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade54ed,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 15}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:05:18.954502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: 3045b911-01c5-4fc3-8e89-ac2d9cea12a8 {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:05:18.954897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 3045b911-01c5-4fc3-8e89-ac2d9cea12a8 updated. Details: {'device': '3045b911-01c5-4fc3-8e89-ac2d9cea12a8', 'device_id': 'd7fde424-29f8-4dba-95d8-51709b034af5', 'network_id': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'port_id': '3045b911-01c5-4fc3-8e89-ac2d9cea12a8', 'mac_address': 'fa:16:3e:f1:55:69', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '2b17f894-c374-4207-90ad-14f794c86627', 'ip_address': '172.37.7.253'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 04 01:05:18.955937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-3045b911-01, col_values=(('tag', 2),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:18.957849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-3045b911-01, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:18.958582 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-3045b911-01, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:18.959336 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 01:05:18.962362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-3045b911-01, col_values=(('other_config', {'net_uuid': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:18.963108 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 01:05:18.967179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade54ef,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 14}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:05:18.971429 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:255 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 15 devices currently available. Time elapsed: 0.091 Sep 04 01:05:18.971429 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Preparing device filters for 2 new devices {{(pid=107812) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 04 01:05:18.971429 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Preparing filters for devices {'f38c3884-111a-49d9-bcf1-6a965ff5e110', '4ed942cd-0f45-4d77-a66d-1d6c875877dc'} Sep 04 01:05:18.971429 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information for ports dict_keys([]) {{(pid=107812) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 04 01:05:18.971429 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information {{(pid=107812) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 04 01:05:18.976730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 2 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:05:19.106337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b142349-2faa-4b98-97c7-8b9bdc669f95]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:05:19.107068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Refreshing firewall for 2 devices {{(pid=107812) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 04 01:05:19.107339 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Refresh firewall rules Sep 04 01:05:19.109719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information for ports dict_keys([]) {{(pid=107812) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 04 01:05:19.109995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information {{(pid=107812) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 04 01:05:19.140787 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4272218f-b884-480e-8fcf-6d5e63a597f2 None None] Resource Port 378bbdd4-3077-4657-8055-fdc0a7600948 updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=378bbdd4-3077-4657-8055-fdc0a7600948,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=378bbdd4-3077-4657-8055-fdc0a7600948,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=378bbdd4-3077-4657-8055-fdc0a7600948,segment=NetworkSegment(79b84dcb-99f6-4af2-ac73-30fcaae597f6),segment_id=79b84dcb-99f6-4af2-ac73-30fcaae597f6)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:05:19.141617 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4272218f-b884-480e-8fcf-6d5e63a597f2 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (378bbdd4-3077-4657-8055-fdc0a7600948), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:19.143190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 4 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:05:19.228763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[75590172-80a2-4f2b-a60d-037cefb0a888]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:05:19.229596 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:255 - agent port security group processed in 0.352 Sep 04 01:05:19.230328 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for 1cf499fb-10a0-4af2-afec-5f610dc85da6 to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 01:05:19.230631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for 4ed942cd-0f45-4d77-a66d-1d6c875877dc to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 01:05:19.230925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for 3045b911-01c5-4fc3-8e89-ac2d9cea12a8 to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 01:05:19.512975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-46d83034-fd0b-41dd-9d56-9f6b577c95e9 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:05:18Z,description='tempest-description--1029102938',id=f1cdaab5-9805-40c3-b794-76bf42b9b813,is_default=False,name='tempest-securitygroup--1092877388',project_id='287d111f08ac4b05bd5adec9c40d0620',revision_number=1,rules=[SecurityGroupRule(199678bd-948c-4ce5-98d9-032a3b3e056e),SecurityGroupRule(f3493799-7a1a-420f-9df2-99beea0201b4)],shared=False,stateful=True,updated_at=2022-09-04T01:05:18Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:19.513470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-46d83034-fd0b-41dd-9d56-9f6b577c95e9 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (f1cdaab5-9805-40c3-b794-76bf42b9b813), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:19.514125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-46d83034-fd0b-41dd-9d56-9f6b577c95e9 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:05:18Z,description=,direction='egress',ethertype='IPv6',id=199678bd-948c-4ce5-98d9-032a3b3e056e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='287d111f08ac4b05bd5adec9c40d0620',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=f1cdaab5-9805-40c3-b794-76bf42b9b813,updated_at=2022-09-04T01:05:18Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:19.514536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-46d83034-fd0b-41dd-9d56-9f6b577c95e9 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (199678bd-948c-4ce5-98d9-032a3b3e056e), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:19.514881 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-46d83034-fd0b-41dd-9d56-9f6b577c95e9 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Security group rule updated ['f1cdaab5-9805-40c3-b794-76bf42b9b813'] Sep 04 01:05:19.515608 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-46d83034-fd0b-41dd-9d56-9f6b577c95e9 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:05:18Z,description=,direction='egress',ethertype='IPv4',id=f3493799-7a1a-420f-9df2-99beea0201b4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='287d111f08ac4b05bd5adec9c40d0620',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=f1cdaab5-9805-40c3-b794-76bf42b9b813,updated_at=2022-09-04T01:05:18Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:19.515969 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-46d83034-fd0b-41dd-9d56-9f6b577c95e9 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (f3493799-7a1a-420f-9df2-99beea0201b4), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:19.516302 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-46d83034-fd0b-41dd-9d56-9f6b577c95e9 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Security group rule updated ['f1cdaab5-9805-40c3-b794-76bf42b9b813'] Sep 04 01:05:19.623730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-5eaebb4d-e20c-4990-9fd7-a6b055609b53 tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:05:18Z,description='',direction='ingress',ethertype='IPv4',id=2a82bd6f-bae3-46b9-9d13-e5e21332649f,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='55faed42b7f243df9df879d581797f56',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=28889e15-3fb7-44d1-a902-1d3272393b5a,updated_at=2022-09-04T01:05:18Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:19.623730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-5eaebb4d-e20c-4990-9fd7-a6b055609b53 tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (2a82bd6f-bae3-46b9-9d13-e5e21332649f), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:19.623730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-5eaebb4d-e20c-4990-9fd7-a6b055609b53 tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Security group rule updated ['28889e15-3fb7-44d1-a902-1d3272393b5a'] Sep 04 01:05:19.723365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["31683484-7b44-44e5-80e9-fdec0a727376","insert","qg-6771cbc4-3e",["set",[]],["map",[["attached-mac","fa:16:3e:50:c6:c9"],["iface-id","6771cbc4-3e4b-419f-b87f-2db662f6e010"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:05:19.743117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["31683484-7b44-44e5-80e9-fdec0a727376","old",null,["set",[]],null],["","new","qg-6771cbc4-3e",17,["map",[["attached-mac","fa:16:3e:50:c6:c9"],["iface-id","6771cbc4-3e4b-419f-b87f-2db662f6e010"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:05:20.331470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-867c3d79-de0a-459d-be9b-919b8cc34652 tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:05:20Z,description='',direction='ingress',ethertype='IPv4',id=0952f260-02fb-4d4b-b582-b1bd8a8376d3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='55faed42b7f243df9df879d581797f56',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=28889e15-3fb7-44d1-a902-1d3272393b5a,updated_at=2022-09-04T01:05:20Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:20.333146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-867c3d79-de0a-459d-be9b-919b8cc34652 tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (0952f260-02fb-4d4b-b582-b1bd8a8376d3), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:20.333802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-867c3d79-de0a-459d-be9b-919b8cc34652 tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Security group rule updated ['28889e15-3fb7-44d1-a902-1d3272393b5a'] Sep 04 01:05:20.379031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["3f1c4103-9a56-464a-8fe0-0830743bb384","insert","qr-c2f724af-5d",["set",[]],["map",[["attached-mac","fa:16:3e:fb:1a:e1"],["iface-id","c2f724af-5dbd-4d91-83cd-c5152b744599"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:05:20.390833 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["3f1c4103-9a56-464a-8fe0-0830743bb384","old",null,["set",[]],null],["","new","qr-c2f724af-5d",18,["map",[["attached-mac","fa:16:3e:fb:1a:e1"],["iface-id","c2f724af-5dbd-4d91-83cd-c5152b744599"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:05:20.565780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4274f3fe-a9c1-48da-bc8d-7683fb0ba52a admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:05:20Z,description='Default security group',id=55cd1a34-8e16-47bc-adb1-3cfa8d24e96c,is_default=True,name='default',project_id='42de058800864cb7b2e062ad4bd1fd46',revision_number=1,rules=[SecurityGroupRule(46b33023-0386-4b95-a921-0db7c940d26d),SecurityGroupRule(66052c5f-bf1d-471b-be9a-78a3bac1026e),SecurityGroupRule(82ef4fe5-3b14-43c0-b235-d9ed79a630e6),SecurityGroupRule(9ef07661-c335-4b63-832c-628ca7279814)],shared=False,stateful=True,updated_at=2022-09-04T01:05:20Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:20.567064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4274f3fe-a9c1-48da-bc8d-7683fb0ba52a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (55cd1a34-8e16-47bc-adb1-3cfa8d24e96c), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:20.568059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4274f3fe-a9c1-48da-bc8d-7683fb0ba52a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:05:20Z,description=,direction='egress',ethertype='IPv4',id=46b33023-0386-4b95-a921-0db7c940d26d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='42de058800864cb7b2e062ad4bd1fd46',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=55cd1a34-8e16-47bc-adb1-3cfa8d24e96c,updated_at=2022-09-04T01:05:20Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:20.568860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4274f3fe-a9c1-48da-bc8d-7683fb0ba52a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (46b33023-0386-4b95-a921-0db7c940d26d), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:20.571296 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-4274f3fe-a9c1-48da-bc8d-7683fb0ba52a admin admin] Security group rule updated ['55cd1a34-8e16-47bc-adb1-3cfa8d24e96c'] Sep 04 01:05:20.573434 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4274f3fe-a9c1-48da-bc8d-7683fb0ba52a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:05:20Z,description=,direction='egress',ethertype='IPv6',id=66052c5f-bf1d-471b-be9a-78a3bac1026e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='42de058800864cb7b2e062ad4bd1fd46',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=55cd1a34-8e16-47bc-adb1-3cfa8d24e96c,updated_at=2022-09-04T01:05:20Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:20.575151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4274f3fe-a9c1-48da-bc8d-7683fb0ba52a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (66052c5f-bf1d-471b-be9a-78a3bac1026e), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:20.581132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-4274f3fe-a9c1-48da-bc8d-7683fb0ba52a admin admin] Security group rule updated ['55cd1a34-8e16-47bc-adb1-3cfa8d24e96c'] Sep 04 01:05:20.582377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4274f3fe-a9c1-48da-bc8d-7683fb0ba52a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:05:20Z,description=,direction='ingress',ethertype='IPv6',id=82ef4fe5-3b14-43c0-b235-d9ed79a630e6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='42de058800864cb7b2e062ad4bd1fd46',protocol=,remote_address_group_id=,remote_group_id=55cd1a34-8e16-47bc-adb1-3cfa8d24e96c,remote_ip_prefix=,revision_number=0,security_group_id=55cd1a34-8e16-47bc-adb1-3cfa8d24e96c,updated_at=2022-09-04T01:05:20Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:20.583636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4274f3fe-a9c1-48da-bc8d-7683fb0ba52a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (82ef4fe5-3b14-43c0-b235-d9ed79a630e6), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:20.584876 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-4274f3fe-a9c1-48da-bc8d-7683fb0ba52a admin admin] Security group rule updated ['55cd1a34-8e16-47bc-adb1-3cfa8d24e96c'] Sep 04 01:05:20.588897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4274f3fe-a9c1-48da-bc8d-7683fb0ba52a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:05:20Z,description=,direction='ingress',ethertype='IPv4',id=9ef07661-c335-4b63-832c-628ca7279814,normalized_cidr=None,port_range_max=,port_range_min=,project_id='42de058800864cb7b2e062ad4bd1fd46',protocol=,remote_address_group_id=,remote_group_id=55cd1a34-8e16-47bc-adb1-3cfa8d24e96c,remote_ip_prefix=,revision_number=0,security_group_id=55cd1a34-8e16-47bc-adb1-3cfa8d24e96c,updated_at=2022-09-04T01:05:20Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:20.594455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4274f3fe-a9c1-48da-bc8d-7683fb0ba52a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (9ef07661-c335-4b63-832c-628ca7279814), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:20.594455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-4274f3fe-a9c1-48da-bc8d-7683fb0ba52a admin admin] Security group rule updated ['55cd1a34-8e16-47bc-adb1-3cfa8d24e96c'] Sep 04 01:05:20.661633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["c4cde41c-c347-4cfb-9a6d-f1918d5c9489","insert","qr-378bbdd4-30",["set",[]],["map",[["attached-mac","fa:16:3e:0e:91:eb"],["iface-id","378bbdd4-3077-4657-8055-fdc0a7600948"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:05:20.697447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["c4cde41c-c347-4cfb-9a6d-f1918d5c9489","old",null,["set",[]],null],["","new","qr-378bbdd4-30",19,["map",[["attached-mac","fa:16:3e:0e:91:eb"],["iface-id","378bbdd4-3077-4657-8055-fdc0a7600948"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:05:21.126116 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-a28b852f-c9f1-4fdf-8627-a363802f5437 None None] Resource Port a6788698-0516-4d8a-8fe8-2add6e7f6e94 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=a6788698-0516-4d8a-8fe8-2add6e7f6e94,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=a6788698-0516-4d8a-8fe8-2add6e7f6e94,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:05:21.126916 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-a28b852f-c9f1-4fdf-8627-a363802f5437 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (a6788698-0516-4d8a-8fe8-2add6e7f6e94), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:21.266102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-5b3066e1-ba11-44e5-8604-140ff2df0bf8 admin admin] Resource SecurityGroup deleted: 55cd1a34-8e16-47bc-adb1-3cfa8d24e96c {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:21.266614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-5b3066e1-ba11-44e5-8604-140ff2df0bf8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (55cd1a34-8e16-47bc-adb1-3cfa8d24e96c), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:21.267287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b3066e1-ba11-44e5-8604-140ff2df0bf8 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('55cd1a34-8e16-47bc-adb1-3cfa8d24e96c',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:05:21.309541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Resource Port 4ed942cd-0f45-4d77-a66d-1d6c875877dc updated (revision_number 3->4). Old fields: {'status': 'DOWN', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=4ed942cd-0f45-4d77-a66d-1d6c875877dc,segment=NetworkSegment(c26850af-ca47-4ea8-9a33-a34f3381800e),segment_id=c26850af-ca47-4ea8-9a33-a34f3381800e)]} New fields: {'status': 'ACTIVE', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=4ed942cd-0f45-4d77-a66d-1d6c875877dc,segment=NetworkSegment(c26850af-ca47-4ea8-9a33-a34f3381800e),segment_id=c26850af-ca47-4ea8-9a33-a34f3381800e)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:05:21.310678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (4ed942cd-0f45-4d77-a66d-1d6c875877dc), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:21.318189 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-5b3066e1-ba11-44e5-8604-140ff2df0bf8 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('55cd1a34-8e16-47bc-adb1-3cfa8d24e96c',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:05:21.318971 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-5b3066e1-ba11-44e5-8604-140ff2df0bf8 admin admin] Resource SecurityGroupRule deleted: 46b33023-0386-4b95-a921-0db7c940d26d {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:21.319454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-5b3066e1-ba11-44e5-8604-140ff2df0bf8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (46b33023-0386-4b95-a921-0db7c940d26d), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:21.319917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-5b3066e1-ba11-44e5-8604-140ff2df0bf8 admin admin] Security group rule updated ['55cd1a34-8e16-47bc-adb1-3cfa8d24e96c'] Sep 04 01:05:21.320586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-5b3066e1-ba11-44e5-8604-140ff2df0bf8 admin admin] Resource SecurityGroupRule deleted: 66052c5f-bf1d-471b-be9a-78a3bac1026e {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:21.321600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-5b3066e1-ba11-44e5-8604-140ff2df0bf8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (66052c5f-bf1d-471b-be9a-78a3bac1026e), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:21.322525 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-5b3066e1-ba11-44e5-8604-140ff2df0bf8 admin admin] Security group rule updated ['55cd1a34-8e16-47bc-adb1-3cfa8d24e96c'] Sep 04 01:05:21.323207 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-5b3066e1-ba11-44e5-8604-140ff2df0bf8 admin admin] Resource SecurityGroupRule deleted: 82ef4fe5-3b14-43c0-b235-d9ed79a630e6 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:21.326265 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-5b3066e1-ba11-44e5-8604-140ff2df0bf8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (82ef4fe5-3b14-43c0-b235-d9ed79a630e6), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:21.326906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-5b3066e1-ba11-44e5-8604-140ff2df0bf8 admin admin] Security group rule updated ['55cd1a34-8e16-47bc-adb1-3cfa8d24e96c'] Sep 04 01:05:21.327553 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-5b3066e1-ba11-44e5-8604-140ff2df0bf8 admin admin] Resource SecurityGroupRule deleted: 9ef07661-c335-4b63-832c-628ca7279814 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:21.328121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-5b3066e1-ba11-44e5-8604-140ff2df0bf8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (9ef07661-c335-4b63-832c-628ca7279814), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:21.328658 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-5b3066e1-ba11-44e5-8604-140ff2df0bf8 admin admin] Security group rule updated ['55cd1a34-8e16-47bc-adb1-3cfa8d24e96c'] Sep 04 01:05:21.463696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Configuration for devices up ['1cf499fb-10a0-4af2-afec-5f610dc85da6', '4ed942cd-0f45-4d77-a66d-1d6c875877dc', '3045b911-01c5-4fc3-8e89-ac2d9cea12a8'] and devices down [] completed. Sep 04 01:05:21.464271 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:255 - ports processed. Elapsed:2.610 Sep 04 01:05:21.464512 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:255 completed. Processed ports statistics: {'regular': {'added': 2, 'updated': 2, 'removed': 0}}. Elapsed:2.611 Sep 04 01:05:21.465572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Loop iteration exceeded interval (2 vs. 2.6105997562408447)! {{(pid=107812) loop_count_and_wait /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2496}} Sep 04 01:05:21.465994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:256 started Sep 04 01:05:21.470384 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade54f1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=861000000,duration_sec=530,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:05:21.471061 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:05:21.471903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:256 - starting polling. Elapsed:0.006 Sep 04 01:05:21.478484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:21.487761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:256 - port information retrieved. Elapsed:0.022 Sep 04 01:05:21.489616 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Starting to process devices in:{'current': {'3fa24970-97a7-4f46-ac55-0b24323fa402', '9b82da41-d694-43b0-a43b-5998addaf0bf', '3c278ab2-dc61-40f8-ab29-c8cc8b740d7d', 'a62a40a2-96f5-427a-808e-9e63c8644245', '0a1a9f7e-73de-4620-ae03-4b1d50d7f706', '3045b911-01c5-4fc3-8e89-ac2d9cea12a8', '89aa06b4-bbf1-40c2-bb48-500c3aecdf48', 'f38c3884-111a-49d9-bcf1-6a965ff5e110', '6771cbc4-3e4b-419f-b87f-2db662f6e010', '4ed942cd-0f45-4d77-a66d-1d6c875877dc', 'f45b435f-0f64-41fe-a6ec-36683da765f9', '53e7a39c-e9ce-45c4-84af-632f2aac70ae', '378bbdd4-3077-4657-8055-fdc0a7600948', '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', 'dd44c60a-dd0f-4ff2-85ae-8c012af89cf9', 'c2f724af-5dbd-4d91-83cd-c5152b744599', '1cf499fb-10a0-4af2-afec-5f610dc85da6', 'ca102ce7-433c-4029-aabf-33d944165ff1'}, 'added': {'6771cbc4-3e4b-419f-b87f-2db662f6e010', 'c2f724af-5dbd-4d91-83cd-c5152b744599', '378bbdd4-3077-4657-8055-fdc0a7600948'}, 'removed': set(), 'updated': {'4ed942cd-0f45-4d77-a66d-1d6c875877dc', '378bbdd4-3077-4657-8055-fdc0a7600948'}, 're_added': set()} {{(pid=107812) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 04 01:05:21.490510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': 'c2f724af-5dbd-4d91-83cd-c5152b744599', 'device_id': 'e4262b22-bfcc-4362-b0da-5c283cfb2e9a', 'network_id': '3e702e6e-ebe1-46a7-b30d-f3d140ac2993', 'port_id': 'c2f724af-5dbd-4d91-83cd-c5152b744599', 'mac_address': 'fa:16:3e:fb:1a:e1', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 167, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'b8f8e824-5e09-4bb6-bfba-faf43aae1f44', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 01:05:21.491324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': '6771cbc4-3e4b-419f-b87f-2db662f6e010', 'device_id': '61883c33-5f31-4a53-b117-0fe975bce512', 'network_id': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'port_id': '6771cbc4-3e4b-419f-b87f-2db662f6e010', 'mac_address': 'fa:16:3e:50:c6:c9', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '2b17f894-c374-4207-90ad-14f794c86627', 'ip_address': '172.37.7.31'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 01:05:21.492002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': '4ed942cd-0f45-4d77-a66d-1d6c875877dc', 'device_id': 'a6875d57-1898-4fcc-8186-5995078e83c1', 'network_id': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'port_id': '4ed942cd-0f45-4d77-a66d-1d6c875877dc', 'mac_address': 'fa:16:3e:0e:53:5a', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '2b17f894-c374-4207-90ad-14f794c86627', 'ip_address': '172.37.7.166'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 01:05:21.492889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': '378bbdd4-3077-4657-8055-fdc0a7600948', 'device_id': 'd7fde424-29f8-4dba-95d8-51709b034af5', 'network_id': '1fb5aed8-696d-4f87-8b2a-7d29744538a8', 'port_id': '378bbdd4-3077-4657-8055-fdc0a7600948', 'mac_address': 'fa:16:3e:0e:91:eb', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 193, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'cf87fd90-4193-4f02-8ccd-ce8ccea66ca5', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 01:05:21.497941 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: c2f724af-5dbd-4d91-83cd-c5152b744599 {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:05:21.498532 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port c2f724af-5dbd-4d91-83cd-c5152b744599 updated. Details: {'device': 'c2f724af-5dbd-4d91-83cd-c5152b744599', 'device_id': 'e4262b22-bfcc-4362-b0da-5c283cfb2e9a', 'network_id': '3e702e6e-ebe1-46a7-b30d-f3d140ac2993', 'port_id': 'c2f724af-5dbd-4d91-83cd-c5152b744599', 'mac_address': 'fa:16:3e:fb:1a:e1', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 167, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'b8f8e824-5e09-4bb6-bfba-faf43aae1f44', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 5} Sep 04 01:05:21.499860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-c2f724af-5d, col_values=(('tag', 5),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:21.505316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-c2f724af-5d, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:21.505316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-c2f724af-5d, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:21.515448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-c2f724af-5d, col_values=(('other_config', {'net_uuid': '3e702e6e-ebe1-46a7-b30d-f3d140ac2993', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '5', 'segmentation_id': '167'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:21.532396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade54f3,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 18}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:05:21.532396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: 6771cbc4-3e4b-419f-b87f-2db662f6e010 {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:05:21.532597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 6771cbc4-3e4b-419f-b87f-2db662f6e010 updated. Details: {'device': '6771cbc4-3e4b-419f-b87f-2db662f6e010', 'device_id': '61883c33-5f31-4a53-b117-0fe975bce512', 'network_id': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'port_id': '6771cbc4-3e4b-419f-b87f-2db662f6e010', 'mac_address': 'fa:16:3e:50:c6:c9', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '2b17f894-c374-4207-90ad-14f794c86627', 'ip_address': '172.37.7.31'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 04 01:05:21.532597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-6771cbc4-3e, col_values=(('tag', 2),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:21.532597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-6771cbc4-3e, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:21.532597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-6771cbc4-3e, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:21.545936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-6771cbc4-3e, col_values=(('other_config', {'net_uuid': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:21.558484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade54f5,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 17}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:05:21.559049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: 4ed942cd-0f45-4d77-a66d-1d6c875877dc {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:05:21.565465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 4ed942cd-0f45-4d77-a66d-1d6c875877dc updated. Details: {'device': '4ed942cd-0f45-4d77-a66d-1d6c875877dc', 'device_id': 'a6875d57-1898-4fcc-8186-5995078e83c1', 'network_id': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'port_id': '4ed942cd-0f45-4d77-a66d-1d6c875877dc', 'mac_address': 'fa:16:3e:0e:53:5a', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '2b17f894-c374-4207-90ad-14f794c86627', 'ip_address': '172.37.7.166'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 04 01:05:21.565465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-4ed942cd-0f, col_values=(('tag', 2),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:21.565465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-4ed942cd-0f, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:21.565465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-4ed942cd-0f, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:21.565789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 01:05:21.565789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-4ed942cd-0f, col_values=(('other_config', {'net_uuid': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:21.565789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 01:05:21.568610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade54f7,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 15}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:05:21.569220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: 378bbdd4-3077-4657-8055-fdc0a7600948 {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:05:21.569755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 378bbdd4-3077-4657-8055-fdc0a7600948 updated. Details: {'device': '378bbdd4-3077-4657-8055-fdc0a7600948', 'device_id': 'd7fde424-29f8-4dba-95d8-51709b034af5', 'network_id': '1fb5aed8-696d-4f87-8b2a-7d29744538a8', 'port_id': '378bbdd4-3077-4657-8055-fdc0a7600948', 'mac_address': 'fa:16:3e:0e:91:eb', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 193, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'cf87fd90-4193-4f02-8ccd-ce8ccea66ca5', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 8} Sep 04 01:05:21.570909 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-378bbdd4-30, col_values=(('tag', 8),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:21.571579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-378bbdd4-30, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:21.572191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-378bbdd4-30, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:21.581300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-378bbdd4-30, col_values=(('other_config', {'net_uuid': '1fb5aed8-696d-4f87-8b2a-7d29744538a8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '8', 'segmentation_id': '193'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:21.599987 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade54f9,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 19}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:05:21.599987 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:256 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 18 devices currently available. Time elapsed: 0.109 Sep 04 01:05:21.600337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Preparing device filters for 3 new devices {{(pid=107812) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 04 01:05:21.600845 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Preparing filters for devices {'6771cbc4-3e4b-419f-b87f-2db662f6e010', 'c2f724af-5dbd-4d91-83cd-c5152b744599', '378bbdd4-3077-4657-8055-fdc0a7600948'} Sep 04 01:05:21.603730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information for ports dict_keys([]) {{(pid=107812) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 04 01:05:21.604409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information {{(pid=107812) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 04 01:05:21.610853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 6 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:05:21.695593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-a28b852f-c9f1-4fdf-8627-a363802f5437 None None] Resource Port a6788698-0516-4d8a-8fe8-2add6e7f6e94 updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=a6788698-0516-4d8a-8fe8-2add6e7f6e94,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=a6788698-0516-4d8a-8fe8-2add6e7f6e94,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=a6788698-0516-4d8a-8fe8-2add6e7f6e94,segment=NetworkSegment(929a573e-75ef-46ab-9889-4a31869bd81c),segment_id=929a573e-75ef-46ab-9889-4a31869bd81c)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:05:21.696180 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-a28b852f-c9f1-4fdf-8627-a363802f5437 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (a6788698-0516-4d8a-8fe8-2add6e7f6e94), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:21.716842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6fcfa96-7577-47d4-8d96-a8db54b5c7fe]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:05:21.717655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Refreshing firewall for 1 devices {{(pid=107812) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 04 01:05:21.718097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Refresh firewall rules Sep 04 01:05:21.719815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information for ports dict_keys([]) {{(pid=107812) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 04 01:05:21.720192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information {{(pid=107812) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 04 01:05:21.727490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 2 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:05:21.797000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-3448ec57-4f4d-4dc9-a4c4-ff5e9bfa7756 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:05:21Z,description='Default security group',id=c6bf29cf-1350-44bf-b86d-c11c97747e0a,is_default=True,name='default',project_id='e4b9f0ce5a8c47cb85cfc09bbeb8450c',revision_number=1,rules=[SecurityGroupRule(01c51ee3-1274-4cde-a156-79e3b70d034a),SecurityGroupRule(d7886c42-746e-410d-8023-dd66875df226),SecurityGroupRule(f1567ee6-d329-4d36-8bc8-21befa5bb825),SecurityGroupRule(f1c4c8c1-077e-4bdd-a99f-e6ab8deba45e)],shared=False,stateful=True,updated_at=2022-09-04T01:05:21Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:21.798099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-3448ec57-4f4d-4dc9-a4c4-ff5e9bfa7756 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (c6bf29cf-1350-44bf-b86d-c11c97747e0a), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:21.798301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-3448ec57-4f4d-4dc9-a4c4-ff5e9bfa7756 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:05:21Z,description=,direction='egress',ethertype='IPv4',id=01c51ee3-1274-4cde-a156-79e3b70d034a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e4b9f0ce5a8c47cb85cfc09bbeb8450c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c6bf29cf-1350-44bf-b86d-c11c97747e0a,updated_at=2022-09-04T01:05:21Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:21.798671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-3448ec57-4f4d-4dc9-a4c4-ff5e9bfa7756 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (01c51ee3-1274-4cde-a156-79e3b70d034a), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:21.799112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-3448ec57-4f4d-4dc9-a4c4-ff5e9bfa7756 admin admin] Security group rule updated ['c6bf29cf-1350-44bf-b86d-c11c97747e0a'] Sep 04 01:05:21.836564 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[5edce380-cf6d-49c1-8a7d-18786f0a5a14]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:05:21.839201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:256 - agent port security group processed in 0.348 Sep 04 01:05:21.840998 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for c2f724af-5dbd-4d91-83cd-c5152b744599 to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 01:05:21.842024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for 6771cbc4-3e4b-419f-b87f-2db662f6e010 to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 01:05:21.843114 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for 4ed942cd-0f45-4d77-a66d-1d6c875877dc to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 01:05:21.845526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for 378bbdd4-3077-4657-8055-fdc0a7600948 to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 01:05:21.859981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-3448ec57-4f4d-4dc9-a4c4-ff5e9bfa7756 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:05:21Z,description=,direction='ingress',ethertype='IPv6',id=d7886c42-746e-410d-8023-dd66875df226,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e4b9f0ce5a8c47cb85cfc09bbeb8450c',protocol=,remote_address_group_id=,remote_group_id=c6bf29cf-1350-44bf-b86d-c11c97747e0a,remote_ip_prefix=,revision_number=0,security_group_id=c6bf29cf-1350-44bf-b86d-c11c97747e0a,updated_at=2022-09-04T01:05:21Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:21.861891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-3448ec57-4f4d-4dc9-a4c4-ff5e9bfa7756 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (d7886c42-746e-410d-8023-dd66875df226), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:21.862859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-3448ec57-4f4d-4dc9-a4c4-ff5e9bfa7756 admin admin] Security group rule updated ['c6bf29cf-1350-44bf-b86d-c11c97747e0a'] Sep 04 01:05:21.867258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-3448ec57-4f4d-4dc9-a4c4-ff5e9bfa7756 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:05:21Z,description=,direction='egress',ethertype='IPv6',id=f1567ee6-d329-4d36-8bc8-21befa5bb825,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e4b9f0ce5a8c47cb85cfc09bbeb8450c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c6bf29cf-1350-44bf-b86d-c11c97747e0a,updated_at=2022-09-04T01:05:21Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:21.872376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-3448ec57-4f4d-4dc9-a4c4-ff5e9bfa7756 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (f1567ee6-d329-4d36-8bc8-21befa5bb825), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:21.874716 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-3448ec57-4f4d-4dc9-a4c4-ff5e9bfa7756 admin admin] Security group rule updated ['c6bf29cf-1350-44bf-b86d-c11c97747e0a'] Sep 04 01:05:21.876502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-3448ec57-4f4d-4dc9-a4c4-ff5e9bfa7756 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:05:21Z,description=,direction='ingress',ethertype='IPv4',id=f1c4c8c1-077e-4bdd-a99f-e6ab8deba45e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e4b9f0ce5a8c47cb85cfc09bbeb8450c',protocol=,remote_address_group_id=,remote_group_id=c6bf29cf-1350-44bf-b86d-c11c97747e0a,remote_ip_prefix=,revision_number=0,security_group_id=c6bf29cf-1350-44bf-b86d-c11c97747e0a,updated_at=2022-09-04T01:05:21Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:21.877267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-3448ec57-4f4d-4dc9-a4c4-ff5e9bfa7756 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (f1c4c8c1-077e-4bdd-a99f-e6ab8deba45e), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:21.878049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-3448ec57-4f4d-4dc9-a4c4-ff5e9bfa7756 admin admin] Security group rule updated ['c6bf29cf-1350-44bf-b86d-c11c97747e0a'] Sep 04 01:05:22.029443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-fc6f1e7a-a2a9-477f-9476-0a808cb7ad15 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:05:20Z,description='',direction='ingress',ethertype='IPv4',id=8007b0e1-b652-4ead-a980-dd8e3248e4ab,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='287d111f08ac4b05bd5adec9c40d0620',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=f1cdaab5-9805-40c3-b794-76bf42b9b813,updated_at=2022-09-04T01:05:20Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:22.029830 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-fc6f1e7a-a2a9-477f-9476-0a808cb7ad15 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (8007b0e1-b652-4ead-a980-dd8e3248e4ab), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:22.030447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-fc6f1e7a-a2a9-477f-9476-0a808cb7ad15 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Security group rule updated ['f1cdaab5-9805-40c3-b794-76bf42b9b813'] Sep 04 01:05:22.276733 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-2d611adb-6540-45d5-beb6-784c9e3ee872 tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:05:19Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=c7250ad8-1fdb-4a27-b9d9-e7622f80ae4b,mac_address=fa:16:3e:f2:02:54,name='',network_id=e8e0564a-d5c9-4fe0-b2d4-538f45096708,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(c7250ad8-1fdb-4a27-b9d9-e7622f80ae4b),security_group_ids=set([]),status='N/A',updated_at=2022-09-04T01:05:20Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:22.277555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-2d611adb-6540-45d5-beb6-784c9e3ee872 tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (c7250ad8-1fdb-4a27-b9d9-e7622f80ae4b), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:22.519706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Resource Port c2f724af-5dbd-4d91-83cd-c5152b744599 updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:05:22.522647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (c2f724af-5dbd-4d91-83cd-c5152b744599), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:22.622275 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4e5def25-1d6e-4f23-b92c-99a3d6fae7ad admin admin] Resource SecurityGroup deleted: c6bf29cf-1350-44bf-b86d-c11c97747e0a {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:22.623113 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4e5def25-1d6e-4f23-b92c-99a3d6fae7ad admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (c6bf29cf-1350-44bf-b86d-c11c97747e0a), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:22.623987 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e5def25-1d6e-4f23-b92c-99a3d6fae7ad admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('c6bf29cf-1350-44bf-b86d-c11c97747e0a',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:05:22.669565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4e5def25-1d6e-4f23-b92c-99a3d6fae7ad admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('c6bf29cf-1350-44bf-b86d-c11c97747e0a',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:05:22.670039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4e5def25-1d6e-4f23-b92c-99a3d6fae7ad admin admin] Resource SecurityGroupRule deleted: 01c51ee3-1274-4cde-a156-79e3b70d034a {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:22.670406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4e5def25-1d6e-4f23-b92c-99a3d6fae7ad admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (01c51ee3-1274-4cde-a156-79e3b70d034a), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:22.671523 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-4e5def25-1d6e-4f23-b92c-99a3d6fae7ad admin admin] Security group rule updated ['c6bf29cf-1350-44bf-b86d-c11c97747e0a'] Sep 04 01:05:22.671523 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4e5def25-1d6e-4f23-b92c-99a3d6fae7ad admin admin] Resource SecurityGroupRule deleted: d7886c42-746e-410d-8023-dd66875df226 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:22.671523 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4e5def25-1d6e-4f23-b92c-99a3d6fae7ad admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (d7886c42-746e-410d-8023-dd66875df226), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:22.671843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-4e5def25-1d6e-4f23-b92c-99a3d6fae7ad admin admin] Security group rule updated ['c6bf29cf-1350-44bf-b86d-c11c97747e0a'] Sep 04 01:05:22.672252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4e5def25-1d6e-4f23-b92c-99a3d6fae7ad admin admin] Resource SecurityGroupRule deleted: f1567ee6-d329-4d36-8bc8-21befa5bb825 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:22.680236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4e5def25-1d6e-4f23-b92c-99a3d6fae7ad admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (f1567ee6-d329-4d36-8bc8-21befa5bb825), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:22.680928 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-4e5def25-1d6e-4f23-b92c-99a3d6fae7ad admin admin] Security group rule updated ['c6bf29cf-1350-44bf-b86d-c11c97747e0a'] Sep 04 01:05:22.684327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4e5def25-1d6e-4f23-b92c-99a3d6fae7ad admin admin] Resource SecurityGroupRule deleted: f1c4c8c1-077e-4bdd-a99f-e6ab8deba45e {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:22.685159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4e5def25-1d6e-4f23-b92c-99a3d6fae7ad admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (f1c4c8c1-077e-4bdd-a99f-e6ab8deba45e), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:22.685159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-4e5def25-1d6e-4f23-b92c-99a3d6fae7ad admin admin] Security group rule updated ['c6bf29cf-1350-44bf-b86d-c11c97747e0a'] Sep 04 01:05:22.764285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["880e2935-1de3-49f7-9025-0d6d9e028416","insert","qr-a6788698-05",["set",[]],["map",[["attached-mac","fa:16:3e:f9:50:ed"],["iface-id","a6788698-0516-4d8a-8fe8-2add6e7f6e94"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:05:22.766348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["880e2935-1de3-49f7-9025-0d6d9e028416","old",null,["set",[]],null],["","new","qr-a6788698-05",20,["map",[["attached-mac","fa:16:3e:f9:50:ed"],["iface-id","a6788698-0516-4d8a-8fe8-2add6e7f6e94"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:05:23.271999 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Resource Port 6771cbc4-3e4b-419f-b87f-2db662f6e010 updated (revision_number 3->4). Old fields: {'status': 'DOWN', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=6771cbc4-3e4b-419f-b87f-2db662f6e010,segment=NetworkSegment(c26850af-ca47-4ea8-9a33-a34f3381800e),segment_id=c26850af-ca47-4ea8-9a33-a34f3381800e)]} New fields: {'status': 'ACTIVE', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=6771cbc4-3e4b-419f-b87f-2db662f6e010,segment=NetworkSegment(c26850af-ca47-4ea8-9a33-a34f3381800e),segment_id=c26850af-ca47-4ea8-9a33-a34f3381800e)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:05:23.272940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (6771cbc4-3e4b-419f-b87f-2db662f6e010), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:23.343190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-2ee14693-36de-4426-9555-c15400f6b2f7 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:05:22Z,description='',direction='ingress',ethertype='IPv4',id=be54aecb-bdaa-40b9-948a-c685064958fc,normalized_cidr=None,port_range_max=,port_range_min=,project_id='287d111f08ac4b05bd5adec9c40d0620',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=f1cdaab5-9805-40c3-b794-76bf42b9b813,updated_at=2022-09-04T01:05:22Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:23.344022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-2ee14693-36de-4426-9555-c15400f6b2f7 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (be54aecb-bdaa-40b9-948a-c685064958fc), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:23.344746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-2ee14693-36de-4426-9555-c15400f6b2f7 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Security group rule updated ['f1cdaab5-9805-40c3-b794-76bf42b9b813'] Sep 04 01:05:24.013769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Configuration for devices up ['c2f724af-5dbd-4d91-83cd-c5152b744599', '6771cbc4-3e4b-419f-b87f-2db662f6e010', '4ed942cd-0f45-4d77-a66d-1d6c875877dc', '378bbdd4-3077-4657-8055-fdc0a7600948'] and devices down [] completed. Sep 04 01:05:24.019864 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:256 - ports processed. Elapsed:2.548 Sep 04 01:05:24.019864 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:256 completed. Processed ports statistics: {'regular': {'added': 3, 'updated': 2, 'removed': 0}}. Elapsed:2.549 Sep 04 01:05:24.019864 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Loop iteration exceeded interval (2 vs. 2.548654794692993)! {{(pid=107812) loop_count_and_wait /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2496}} Sep 04 01:05:24.019864 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:257 started Sep 04 01:05:24.028553 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade54fb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=413000000,duration_sec=533,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:05:24.031101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:05:24.032729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:257 - starting polling. Elapsed:0.017 Sep 04 01:05:24.051997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:24.071793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:257 - port information retrieved. Elapsed:0.056 Sep 04 01:05:24.075693 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Starting to process devices in:{'current': {'9b82da41-d694-43b0-a43b-5998addaf0bf', '3c278ab2-dc61-40f8-ab29-c8cc8b740d7d', 'c2f724af-5dbd-4d91-83cd-c5152b744599', 'a6788698-0516-4d8a-8fe8-2add6e7f6e94', 'f38c3884-111a-49d9-bcf1-6a965ff5e110', 'a62a40a2-96f5-427a-808e-9e63c8644245', '3fa24970-97a7-4f46-ac55-0b24323fa402', '0a1a9f7e-73de-4620-ae03-4b1d50d7f706', '3045b911-01c5-4fc3-8e89-ac2d9cea12a8', '89aa06b4-bbf1-40c2-bb48-500c3aecdf48', '6771cbc4-3e4b-419f-b87f-2db662f6e010', '4ed942cd-0f45-4d77-a66d-1d6c875877dc', 'f45b435f-0f64-41fe-a6ec-36683da765f9', '53e7a39c-e9ce-45c4-84af-632f2aac70ae', '378bbdd4-3077-4657-8055-fdc0a7600948', '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', 'dd44c60a-dd0f-4ff2-85ae-8c012af89cf9', '1cf499fb-10a0-4af2-afec-5f610dc85da6', 'ca102ce7-433c-4029-aabf-33d944165ff1'}, 'added': {'a6788698-0516-4d8a-8fe8-2add6e7f6e94'}, 'removed': set(), 'updated': {'6771cbc4-3e4b-419f-b87f-2db662f6e010', 'a6788698-0516-4d8a-8fe8-2add6e7f6e94', 'c2f724af-5dbd-4d91-83cd-c5152b744599'}, 're_added': set()} {{(pid=107812) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 04 01:05:24.089487 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': '6771cbc4-3e4b-419f-b87f-2db662f6e010', 'device_id': '61883c33-5f31-4a53-b117-0fe975bce512', 'network_id': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'port_id': '6771cbc4-3e4b-419f-b87f-2db662f6e010', 'mac_address': 'fa:16:3e:50:c6:c9', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '2b17f894-c374-4207-90ad-14f794c86627', 'ip_address': '172.37.7.31'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 01:05:24.093702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': 'a6788698-0516-4d8a-8fe8-2add6e7f6e94', 'device_id': 'a6875d57-1898-4fcc-8186-5995078e83c1', 'network_id': 'd7f39628-666e-4480-8bee-49de183d5e09', 'port_id': 'a6788698-0516-4d8a-8fe8-2add6e7f6e94', 'mac_address': 'fa:16:3e:f9:50:ed', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 172, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '1af847f5-eeac-4b3d-afa5-aa099062676b', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 01:05:24.100355 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': 'c2f724af-5dbd-4d91-83cd-c5152b744599', 'device_id': 'e4262b22-bfcc-4362-b0da-5c283cfb2e9a', 'network_id': '3e702e6e-ebe1-46a7-b30d-f3d140ac2993', 'port_id': 'c2f724af-5dbd-4d91-83cd-c5152b744599', 'mac_address': 'fa:16:3e:fb:1a:e1', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 167, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'b8f8e824-5e09-4bb6-bfba-faf43aae1f44', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 01:05:24.100355 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: 6771cbc4-3e4b-419f-b87f-2db662f6e010 {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:05:24.100677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 6771cbc4-3e4b-419f-b87f-2db662f6e010 updated. Details: {'device': '6771cbc4-3e4b-419f-b87f-2db662f6e010', 'device_id': '61883c33-5f31-4a53-b117-0fe975bce512', 'network_id': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'port_id': '6771cbc4-3e4b-419f-b87f-2db662f6e010', 'mac_address': 'fa:16:3e:50:c6:c9', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '2b17f894-c374-4207-90ad-14f794c86627', 'ip_address': '172.37.7.31'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 04 01:05:24.101806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-6771cbc4-3e, col_values=(('tag', 2),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:24.102440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-6771cbc4-3e, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:24.103000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-6771cbc4-3e, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:24.103591 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 01:05:24.107381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-6771cbc4-3e, col_values=(('other_config', {'net_uuid': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:24.109130 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 01:05:24.115954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade54fd,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 17}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:05:24.116989 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: a6788698-0516-4d8a-8fe8-2add6e7f6e94 {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:05:24.117600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port a6788698-0516-4d8a-8fe8-2add6e7f6e94 updated. Details: {'device': 'a6788698-0516-4d8a-8fe8-2add6e7f6e94', 'device_id': 'a6875d57-1898-4fcc-8186-5995078e83c1', 'network_id': 'd7f39628-666e-4480-8bee-49de183d5e09', 'port_id': 'a6788698-0516-4d8a-8fe8-2add6e7f6e94', 'mac_address': 'fa:16:3e:f9:50:ed', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 172, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '1af847f5-eeac-4b3d-afa5-aa099062676b', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 6} Sep 04 01:05:24.118741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-a6788698-05, col_values=(('tag', 6),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:24.119320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-a6788698-05, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:24.120014 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-a6788698-05, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:24.137325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-a6788698-05, col_values=(('other_config', {'net_uuid': 'd7f39628-666e-4480-8bee-49de183d5e09', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '6', 'segmentation_id': '172'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:24.159167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade54ff,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 20}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:05:24.159511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: c2f724af-5dbd-4d91-83cd-c5152b744599 {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:05:24.160379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port c2f724af-5dbd-4d91-83cd-c5152b744599 updated. Details: {'device': 'c2f724af-5dbd-4d91-83cd-c5152b744599', 'device_id': 'e4262b22-bfcc-4362-b0da-5c283cfb2e9a', 'network_id': '3e702e6e-ebe1-46a7-b30d-f3d140ac2993', 'port_id': 'c2f724af-5dbd-4d91-83cd-c5152b744599', 'mac_address': 'fa:16:3e:fb:1a:e1', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 167, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'b8f8e824-5e09-4bb6-bfba-faf43aae1f44', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 5} Sep 04 01:05:24.161415 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-c2f724af-5d, col_values=(('tag', 5),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:24.161839 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-c2f724af-5d, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:24.162748 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-c2f724af-5d, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:24.170111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 01:05:24.170111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-c2f724af-5d, col_values=(('other_config', {'net_uuid': '3e702e6e-ebe1-46a7-b30d-f3d140ac2993', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '167', 'tag': '5'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:24.170111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 01:05:24.170111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade5501,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 18}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:05:24.170111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:257 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 19 devices currently available. Time elapsed: 0.097 Sep 04 01:05:24.170766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Preparing device filters for 1 new devices {{(pid=107812) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 04 01:05:24.170766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Preparing filters for devices {'a6788698-0516-4d8a-8fe8-2add6e7f6e94'} Sep 04 01:05:24.190441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information for ports dict_keys([]) {{(pid=107812) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 04 01:05:24.196356 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information {{(pid=107812) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 04 01:05:24.205381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 2 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:05:24.232114 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Resource Port 378bbdd4-3077-4657-8055-fdc0a7600948 updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:05:24.235382 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (378bbdd4-3077-4657-8055-fdc0a7600948), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:24.328156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dfbbe02-8711-453a-8bc9-1eb968e3eaa8]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:05:24.331132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Refreshing firewall for 2 devices {{(pid=107812) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 04 01:05:24.331132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Refresh firewall rules Sep 04 01:05:24.335748 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information for ports dict_keys([]) {{(pid=107812) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 04 01:05:24.336823 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information {{(pid=107812) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 04 01:05:24.353181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 4 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:05:24.416568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-2d611adb-6540-45d5-beb6-784c9e3ee872 tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Resource Port c7250ad8-1fdb-4a27-b9d9-e7622f80ae4b updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': '3a1265b2-fba9-42dc-9d80-e5c4ab13b344'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:05:24.417181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-2d611adb-6540-45d5-beb6-784c9e3ee872 tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (c7250ad8-1fdb-4a27-b9d9-e7622f80ae4b), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:24.484358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[812bda37-0ff9-4d8e-b739-b52a2aec79e1]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:05:24.484358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:257 - agent port security group processed in 0.410 Sep 04 01:05:24.484358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for 6771cbc4-3e4b-419f-b87f-2db662f6e010 to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 01:05:24.484358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for a6788698-0516-4d8a-8fe8-2add6e7f6e94 to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 01:05:24.484358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for c2f724af-5dbd-4d91-83cd-c5152b744599 to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 01:05:24.629298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-11ecc638-bf34-49fc-a57a-41d126b7164b tempest-DeleteServersTestJSON-1716711868 tempest-DeleteServersTestJSON-1716711868-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:05:21Z,data_plane_status=None,description='',device_id='742cb4b8-f03c-4256-bb96-fc2cfff43734',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=5d2b3e83-c7f4-4359-8491-abf0d6e3eec3,mac_address=fa:16:3e:56:a9:bb,name='',network_id=3b7528ba-1624-4915-b635-aeb0700ea8e7,numa_affinity_policy=,project_id='e07d8b14fef34e04a0410f12e5dbd2fe',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(5d2b3e83-c7f4-4359-8491-abf0d6e3eec3),security_group_ids=set([703cb105-947c-42c1-9237-d9f950459033]),status='DOWN',updated_at=2022-09-04T01:05:22Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:24.629298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-11ecc638-bf34-49fc-a57a-41d126b7164b tempest-DeleteServersTestJSON-1716711868 tempest-DeleteServersTestJSON-1716711868-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (5d2b3e83-c7f4-4359-8491-abf0d6e3eec3), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:24.630051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-11ecc638-bf34-49fc-a57a-41d126b7164b tempest-DeleteServersTestJSON-1716711868 tempest-DeleteServersTestJSON-1716711868-project] Security group member updated {'703cb105-947c-42c1-9237-d9f950459033'} Sep 04 01:05:25.007773 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4e96daec-f333-424e-857d-905c965d677b tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:05:21Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=5db671be-feec-4d74-8501-0b964112262c,mac_address=fa:16:3e:a4:a0:91,name='',network_id=e8e0564a-d5c9-4fe0-b2d4-538f45096708,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(5db671be-feec-4d74-8501-0b964112262c),security_group_ids=set([]),status='N/A',updated_at=2022-09-04T01:05:22Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:25.008669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4e96daec-f333-424e-857d-905c965d677b tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (5db671be-feec-4d74-8501-0b964112262c), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:25.025674 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-44351cf1-fd5a-4c62-bf84-a816b60bf01e admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:05:24Z,description='Default security group',id=c68cf137-d7a7-431e-9d92-3123725c3567,is_default=True,name='default',project_id='59e345a392104034b113adab2fa35c8f',revision_number=1,rules=[SecurityGroupRule(129f682d-724a-43bb-8b76-d6646a942848),SecurityGroupRule(32941879-22be-4b34-8fec-58f4cadc7165),SecurityGroupRule(7932fa76-db68-470f-bfc5-8d08ee25621e),SecurityGroupRule(f20d2b3c-b226-4c62-a566-5b0d6c799951)],shared=False,stateful=True,updated_at=2022-09-04T01:05:24Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:25.025674 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-44351cf1-fd5a-4c62-bf84-a816b60bf01e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (c68cf137-d7a7-431e-9d92-3123725c3567), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:25.027348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-44351cf1-fd5a-4c62-bf84-a816b60bf01e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:05:24Z,description=,direction='ingress',ethertype='IPv6',id=129f682d-724a-43bb-8b76-d6646a942848,normalized_cidr=None,port_range_max=,port_range_min=,project_id='59e345a392104034b113adab2fa35c8f',protocol=,remote_address_group_id=,remote_group_id=c68cf137-d7a7-431e-9d92-3123725c3567,remote_ip_prefix=,revision_number=0,security_group_id=c68cf137-d7a7-431e-9d92-3123725c3567,updated_at=2022-09-04T01:05:24Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:25.028026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-44351cf1-fd5a-4c62-bf84-a816b60bf01e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (129f682d-724a-43bb-8b76-d6646a942848), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:25.030460 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-44351cf1-fd5a-4c62-bf84-a816b60bf01e admin admin] Security group rule updated ['c68cf137-d7a7-431e-9d92-3123725c3567'] Sep 04 01:05:25.033438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-44351cf1-fd5a-4c62-bf84-a816b60bf01e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:05:24Z,description=,direction='egress',ethertype='IPv6',id=32941879-22be-4b34-8fec-58f4cadc7165,normalized_cidr=None,port_range_max=,port_range_min=,project_id='59e345a392104034b113adab2fa35c8f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c68cf137-d7a7-431e-9d92-3123725c3567,updated_at=2022-09-04T01:05:24Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:25.035721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-44351cf1-fd5a-4c62-bf84-a816b60bf01e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (32941879-22be-4b34-8fec-58f4cadc7165), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:25.037631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-44351cf1-fd5a-4c62-bf84-a816b60bf01e admin admin] Security group rule updated ['c68cf137-d7a7-431e-9d92-3123725c3567'] Sep 04 01:05:25.038660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-44351cf1-fd5a-4c62-bf84-a816b60bf01e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:05:24Z,description=,direction='ingress',ethertype='IPv4',id=7932fa76-db68-470f-bfc5-8d08ee25621e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='59e345a392104034b113adab2fa35c8f',protocol=,remote_address_group_id=,remote_group_id=c68cf137-d7a7-431e-9d92-3123725c3567,remote_ip_prefix=,revision_number=0,security_group_id=c68cf137-d7a7-431e-9d92-3123725c3567,updated_at=2022-09-04T01:05:24Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:25.041436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-44351cf1-fd5a-4c62-bf84-a816b60bf01e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (7932fa76-db68-470f-bfc5-8d08ee25621e), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:25.053571 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-44351cf1-fd5a-4c62-bf84-a816b60bf01e admin admin] Security group rule updated ['c68cf137-d7a7-431e-9d92-3123725c3567'] Sep 04 01:05:25.056862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-44351cf1-fd5a-4c62-bf84-a816b60bf01e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:05:24Z,description=,direction='egress',ethertype='IPv4',id=f20d2b3c-b226-4c62-a566-5b0d6c799951,normalized_cidr=None,port_range_max=,port_range_min=,project_id='59e345a392104034b113adab2fa35c8f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c68cf137-d7a7-431e-9d92-3123725c3567,updated_at=2022-09-04T01:05:24Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:25.057561 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-44351cf1-fd5a-4c62-bf84-a816b60bf01e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (f20d2b3c-b226-4c62-a566-5b0d6c799951), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:25.060119 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-44351cf1-fd5a-4c62-bf84-a816b60bf01e admin admin] Security group rule updated ['c68cf137-d7a7-431e-9d92-3123725c3567'] Sep 04 01:05:25.976267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-84d623ae-ebad-44b8-8d63-848d4d918e54 admin admin] Resource SecurityGroup deleted: c68cf137-d7a7-431e-9d92-3123725c3567 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:25.976713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-84d623ae-ebad-44b8-8d63-848d4d918e54 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (c68cf137-d7a7-431e-9d92-3123725c3567), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:25.977604 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84d623ae-ebad-44b8-8d63-848d4d918e54 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('c68cf137-d7a7-431e-9d92-3123725c3567',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:05:26.000902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-7a3fd437-16cd-4bf1-99c8-9c8c305b9f9e tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:05:24Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=498a0a31-5c9a-4552-a9dd-f3487791491b,mac_address=fa:16:3e:32:42:71,name='',network_id=e8e0564a-d5c9-4fe0-b2d4-538f45096708,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(498a0a31-5c9a-4552-a9dd-f3487791491b),security_group_ids=set([]),status='N/A',updated_at=2022-09-04T01:05:24Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:26.008977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-7a3fd437-16cd-4bf1-99c8-9c8c305b9f9e tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (498a0a31-5c9a-4552-a9dd-f3487791491b), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:26.085883 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-84d623ae-ebad-44b8-8d63-848d4d918e54 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('c68cf137-d7a7-431e-9d92-3123725c3567',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:05:26.087078 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-84d623ae-ebad-44b8-8d63-848d4d918e54 admin admin] Resource SecurityGroupRule deleted: 129f682d-724a-43bb-8b76-d6646a942848 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:26.087603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-84d623ae-ebad-44b8-8d63-848d4d918e54 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (129f682d-724a-43bb-8b76-d6646a942848), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:26.088080 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-84d623ae-ebad-44b8-8d63-848d4d918e54 admin admin] Security group rule updated ['c68cf137-d7a7-431e-9d92-3123725c3567'] Sep 04 01:05:26.088667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-84d623ae-ebad-44b8-8d63-848d4d918e54 admin admin] Resource SecurityGroupRule deleted: 32941879-22be-4b34-8fec-58f4cadc7165 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:26.090311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-84d623ae-ebad-44b8-8d63-848d4d918e54 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (32941879-22be-4b34-8fec-58f4cadc7165), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:26.090878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-84d623ae-ebad-44b8-8d63-848d4d918e54 admin admin] Security group rule updated ['c68cf137-d7a7-431e-9d92-3123725c3567'] Sep 04 01:05:26.092702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-84d623ae-ebad-44b8-8d63-848d4d918e54 admin admin] Resource SecurityGroupRule deleted: 7932fa76-db68-470f-bfc5-8d08ee25621e {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:26.101392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-84d623ae-ebad-44b8-8d63-848d4d918e54 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (7932fa76-db68-470f-bfc5-8d08ee25621e), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:26.102003 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-84d623ae-ebad-44b8-8d63-848d4d918e54 admin admin] Security group rule updated ['c68cf137-d7a7-431e-9d92-3123725c3567'] Sep 04 01:05:26.103046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-84d623ae-ebad-44b8-8d63-848d4d918e54 admin admin] Resource SecurityGroupRule deleted: f20d2b3c-b226-4c62-a566-5b0d6c799951 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:26.103565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-84d623ae-ebad-44b8-8d63-848d4d918e54 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (f20d2b3c-b226-4c62-a566-5b0d6c799951), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:26.104032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-84d623ae-ebad-44b8-8d63-848d4d918e54 admin admin] Security group rule updated ['c68cf137-d7a7-431e-9d92-3123725c3567'] Sep 04 01:05:26.113819 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Resource Port a6788698-0516-4d8a-8fe8-2add6e7f6e94 updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:05:26.115332 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (a6788698-0516-4d8a-8fe8-2add6e7f6e94), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:26.180339 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Configuration for devices up ['6771cbc4-3e4b-419f-b87f-2db662f6e010', 'a6788698-0516-4d8a-8fe8-2add6e7f6e94', 'c2f724af-5dbd-4d91-83cd-c5152b744599'] and devices down [] completed. Sep 04 01:05:26.180339 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:257 - ports processed. Elapsed:2.162 Sep 04 01:05:26.180339 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:257 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 3, 'removed': 0}}. Elapsed:2.162 Sep 04 01:05:26.180339 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Loop iteration exceeded interval (2 vs. 2.162198781967163)! {{(pid=107812) loop_count_and_wait /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2496}} Sep 04 01:05:26.180339 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:258 started Sep 04 01:05:26.182756 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5503,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=573000000,duration_sec=535,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:05:26.183601 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:05:26.184214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:258 - starting polling. Elapsed:0.005 Sep 04 01:05:26.189624 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:26.208243 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:258 - port information retrieved. Elapsed:0.025 Sep 04 01:05:26.208734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Starting to process devices in:{'current': {'9b82da41-d694-43b0-a43b-5998addaf0bf', '3c278ab2-dc61-40f8-ab29-c8cc8b740d7d', 'c2f724af-5dbd-4d91-83cd-c5152b744599', 'a6788698-0516-4d8a-8fe8-2add6e7f6e94', 'f38c3884-111a-49d9-bcf1-6a965ff5e110', 'a62a40a2-96f5-427a-808e-9e63c8644245', '3fa24970-97a7-4f46-ac55-0b24323fa402', '0a1a9f7e-73de-4620-ae03-4b1d50d7f706', '3045b911-01c5-4fc3-8e89-ac2d9cea12a8', '89aa06b4-bbf1-40c2-bb48-500c3aecdf48', '6771cbc4-3e4b-419f-b87f-2db662f6e010', '4ed942cd-0f45-4d77-a66d-1d6c875877dc', 'f45b435f-0f64-41fe-a6ec-36683da765f9', '53e7a39c-e9ce-45c4-84af-632f2aac70ae', '378bbdd4-3077-4657-8055-fdc0a7600948', '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', 'dd44c60a-dd0f-4ff2-85ae-8c012af89cf9', '1cf499fb-10a0-4af2-afec-5f610dc85da6', 'ca102ce7-433c-4029-aabf-33d944165ff1'}, 'added': set(), 'removed': set(), 'updated': {'a6788698-0516-4d8a-8fe8-2add6e7f6e94', '378bbdd4-3077-4657-8055-fdc0a7600948'}, 're_added': set()} {{(pid=107812) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 04 01:05:26.209349 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': 'a6788698-0516-4d8a-8fe8-2add6e7f6e94', 'device_id': 'a6875d57-1898-4fcc-8186-5995078e83c1', 'network_id': 'd7f39628-666e-4480-8bee-49de183d5e09', 'port_id': 'a6788698-0516-4d8a-8fe8-2add6e7f6e94', 'mac_address': 'fa:16:3e:f9:50:ed', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 172, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '1af847f5-eeac-4b3d-afa5-aa099062676b', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 01:05:26.209815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': '378bbdd4-3077-4657-8055-fdc0a7600948', 'device_id': 'd7fde424-29f8-4dba-95d8-51709b034af5', 'network_id': '1fb5aed8-696d-4f87-8b2a-7d29744538a8', 'port_id': '378bbdd4-3077-4657-8055-fdc0a7600948', 'mac_address': 'fa:16:3e:0e:91:eb', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 193, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'cf87fd90-4193-4f02-8ccd-ce8ccea66ca5', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 01:05:26.223940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: a6788698-0516-4d8a-8fe8-2add6e7f6e94 {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:05:26.224318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port a6788698-0516-4d8a-8fe8-2add6e7f6e94 updated. Details: {'device': 'a6788698-0516-4d8a-8fe8-2add6e7f6e94', 'device_id': 'a6875d57-1898-4fcc-8186-5995078e83c1', 'network_id': 'd7f39628-666e-4480-8bee-49de183d5e09', 'port_id': 'a6788698-0516-4d8a-8fe8-2add6e7f6e94', 'mac_address': 'fa:16:3e:f9:50:ed', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 172, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '1af847f5-eeac-4b3d-afa5-aa099062676b', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 6} Sep 04 01:05:26.226085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-a6788698-05, col_values=(('tag', 6),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:26.226591 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-a6788698-05, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:26.229310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-a6788698-05, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:26.229851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 01:05:26.242582 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-a6788698-05, col_values=(('other_config', {'net_uuid': 'd7f39628-666e-4480-8bee-49de183d5e09', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '172', 'tag': '6'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:26.244396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 01:05:26.256048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade5505,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 20}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:05:26.258733 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: 378bbdd4-3077-4657-8055-fdc0a7600948 {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:05:26.259644 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 378bbdd4-3077-4657-8055-fdc0a7600948 updated. Details: {'device': '378bbdd4-3077-4657-8055-fdc0a7600948', 'device_id': 'd7fde424-29f8-4dba-95d8-51709b034af5', 'network_id': '1fb5aed8-696d-4f87-8b2a-7d29744538a8', 'port_id': '378bbdd4-3077-4657-8055-fdc0a7600948', 'mac_address': 'fa:16:3e:0e:91:eb', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 193, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'cf87fd90-4193-4f02-8ccd-ce8ccea66ca5', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 8} Sep 04 01:05:26.265878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-378bbdd4-30, col_values=(('tag', 8),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:26.265878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-378bbdd4-30, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:26.269897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-378bbdd4-30, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:26.270656 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 01:05:26.275824 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-378bbdd4-30, col_values=(('other_config', {'net_uuid': '1fb5aed8-696d-4f87-8b2a-7d29744538a8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '193', 'tag': '8'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:26.278241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 01:05:26.309230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade5507,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 19}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:05:26.310547 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:258 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 19 devices currently available. Time elapsed: 0.101 Sep 04 01:05:26.349235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Refreshing firewall for 2 devices {{(pid=107812) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 04 01:05:26.349235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Refresh firewall rules Sep 04 01:05:26.349235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information for ports dict_keys([]) {{(pid=107812) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 04 01:05:26.349235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information {{(pid=107812) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 04 01:05:26.349235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 4 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:05:26.506381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[8141d98e-748f-49ff-9e12-0025450295b8]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:05:26.507374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:258 - agent port security group processed in 0.298 Sep 04 01:05:26.508616 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for a6788698-0516-4d8a-8fe8-2add6e7f6e94 to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 01:05:26.509761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for 378bbdd4-3077-4657-8055-fdc0a7600948 to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 01:05:27.595696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Configuration for devices up ['a6788698-0516-4d8a-8fe8-2add6e7f6e94', '378bbdd4-3077-4657-8055-fdc0a7600948'] and devices down [] completed. Sep 04 01:05:27.595696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:258 - ports processed. Elapsed:1.411 Sep 04 01:05:27.595696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:258 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 2, 'removed': 0}}. Elapsed:1.412 Sep 04 01:05:27.914379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-7a3fd437-16cd-4bf1-99c8-9c8c305b9f9e tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Resource Port 498a0a31-5c9a-4552-a9dd-f3487791491b updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': '29aaa1bc-70e4-4290-b00e-49a0f08b213d'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:05:27.914379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-7a3fd437-16cd-4bf1-99c8-9c8c305b9f9e tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (498a0a31-5c9a-4552-a9dd-f3487791491b), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:28.180154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:259 started Sep 04 01:05:28.183809 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5509,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=575000000,duration_sec=537,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:05:28.185112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:05:28.185503 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:259 - starting polling. Elapsed:0.006 Sep 04 01:05:28.188144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:28.192762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:259 - port information retrieved. Elapsed:0.013 Sep 04 01:05:28.193111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:259 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Sep 04 01:05:28.984516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4e96daec-f333-424e-857d-905c965d677b tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Resource Port 5db671be-feec-4d74-8501-0b964112262c updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': 'f81c9b73-9b50-4b22-bc3c-3eb35bd2fbaa'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:05:28.987311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4e96daec-f333-424e-857d-905c965d677b tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (5db671be-feec-4d74-8501-0b964112262c), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:29.131918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-3f6bac78-39af-476c-8571-1ff59d8f90cf tempest-ServerRescueNegativeTestJSON-1367456352 tempest-ServerRescueNegativeTestJSON-1367456352-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:05:25Z,data_plane_status=None,description='',device_id='2f7a7e72-1f16-4ab4-b826-d376d39be4c2',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=28efc83e-9838-45a7-9fd3-3625eeff4b09,mac_address=fa:16:3e:25:76:bc,name='',network_id=b16f22e1-6fb1-440b-98eb-845123e960e6,numa_affinity_policy=,project_id='db72b63281384bd883b04d05bcc35677',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(28efc83e-9838-45a7-9fd3-3625eeff4b09),security_group_ids=set([258c239a-16c7-45ea-bf27-4f76d118a726]),status='DOWN',updated_at=2022-09-04T01:05:26Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:29.136598 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-3f6bac78-39af-476c-8571-1ff59d8f90cf tempest-ServerRescueNegativeTestJSON-1367456352 tempest-ServerRescueNegativeTestJSON-1367456352-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (28efc83e-9838-45a7-9fd3-3625eeff4b09), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:29.138034 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-3f6bac78-39af-476c-8571-1ff59d8f90cf tempest-ServerRescueNegativeTestJSON-1367456352 tempest-ServerRescueNegativeTestJSON-1367456352-project] Security group member updated {'258c239a-16c7-45ea-bf27-4f76d118a726'} Sep 04 01:05:29.695954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-7b471ae6-c435-45c4-a0cc-8878748e88b5 service neutron] Resource Port 5d2b3e83-c7f4-4359-8491-abf0d6e3eec3 updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=5d2b3e83-c7f4-4359-8491-abf0d6e3eec3,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=5d2b3e83-c7f4-4359-8491-abf0d6e3eec3,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:05:29.697397 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-7b471ae6-c435-45c4-a0cc-8878748e88b5 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (5d2b3e83-c7f4-4359-8491-abf0d6e3eec3), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:30.192430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:260 started Sep 04 01:05:30.210730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade550b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=596000000,duration_sec=539,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:05:30.212020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:05:30.214366 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:260 - starting polling. Elapsed:0.022 Sep 04 01:05:30.224012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:30.264149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:260 - port information retrieved. Elapsed:0.069 Sep 04 01:05:30.268274 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:260 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.072 Sep 04 01:05:30.414615 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-298a70aa-41d6-44b2-8b21-eaeea6232450 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:05:29Z,description='Default security group',id=e8b668b4-bea8-4d8c-a255-407d62d73cce,is_default=True,name='default',project_id='3ea5113c49d4461695f17b1499fc7b43',revision_number=1,rules=[SecurityGroupRule(36011279-d672-4fd2-ad35-c9417c3ffd84),SecurityGroupRule(3e0a9519-396e-472e-af77-616ce29eccef),SecurityGroupRule(a891bf9e-513c-456a-b5d0-c9c353420b62),SecurityGroupRule(f4fe0bce-a64c-4c7d-9176-fc67aa715f1d)],shared=False,stateful=True,updated_at=2022-09-04T01:05:29Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:30.415626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-298a70aa-41d6-44b2-8b21-eaeea6232450 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (e8b668b4-bea8-4d8c-a255-407d62d73cce), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:30.416643 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-298a70aa-41d6-44b2-8b21-eaeea6232450 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:05:29Z,description=,direction='ingress',ethertype='IPv6',id=36011279-d672-4fd2-ad35-c9417c3ffd84,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3ea5113c49d4461695f17b1499fc7b43',protocol=,remote_address_group_id=,remote_group_id=e8b668b4-bea8-4d8c-a255-407d62d73cce,remote_ip_prefix=,revision_number=0,security_group_id=e8b668b4-bea8-4d8c-a255-407d62d73cce,updated_at=2022-09-04T01:05:29Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:30.417230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-298a70aa-41d6-44b2-8b21-eaeea6232450 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (36011279-d672-4fd2-ad35-c9417c3ffd84), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:30.426009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-298a70aa-41d6-44b2-8b21-eaeea6232450 admin admin] Security group rule updated ['e8b668b4-bea8-4d8c-a255-407d62d73cce'] Sep 04 01:05:30.427493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-298a70aa-41d6-44b2-8b21-eaeea6232450 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:05:29Z,description=,direction='ingress',ethertype='IPv4',id=3e0a9519-396e-472e-af77-616ce29eccef,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3ea5113c49d4461695f17b1499fc7b43',protocol=,remote_address_group_id=,remote_group_id=e8b668b4-bea8-4d8c-a255-407d62d73cce,remote_ip_prefix=,revision_number=0,security_group_id=e8b668b4-bea8-4d8c-a255-407d62d73cce,updated_at=2022-09-04T01:05:29Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:30.428148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-298a70aa-41d6-44b2-8b21-eaeea6232450 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (3e0a9519-396e-472e-af77-616ce29eccef), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:30.442071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-298a70aa-41d6-44b2-8b21-eaeea6232450 admin admin] Security group rule updated ['e8b668b4-bea8-4d8c-a255-407d62d73cce'] Sep 04 01:05:30.443996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-298a70aa-41d6-44b2-8b21-eaeea6232450 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:05:30Z,description=,direction='egress',ethertype='IPv6',id=a891bf9e-513c-456a-b5d0-c9c353420b62,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3ea5113c49d4461695f17b1499fc7b43',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e8b668b4-bea8-4d8c-a255-407d62d73cce,updated_at=2022-09-04T01:05:30Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:30.445238 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-298a70aa-41d6-44b2-8b21-eaeea6232450 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (a891bf9e-513c-456a-b5d0-c9c353420b62), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:30.447257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-298a70aa-41d6-44b2-8b21-eaeea6232450 admin admin] Security group rule updated ['e8b668b4-bea8-4d8c-a255-407d62d73cce'] Sep 04 01:05:30.448667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-298a70aa-41d6-44b2-8b21-eaeea6232450 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:05:29Z,description=,direction='egress',ethertype='IPv4',id=f4fe0bce-a64c-4c7d-9176-fc67aa715f1d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3ea5113c49d4461695f17b1499fc7b43',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e8b668b4-bea8-4d8c-a255-407d62d73cce,updated_at=2022-09-04T01:05:29Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:30.450273 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-298a70aa-41d6-44b2-8b21-eaeea6232450 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (f4fe0bce-a64c-4c7d-9176-fc67aa715f1d), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:30.451057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-298a70aa-41d6-44b2-8b21-eaeea6232450 admin admin] Security group rule updated ['e8b668b4-bea8-4d8c-a255-407d62d73cce'] Sep 04 01:05:30.934349 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b9d2dd3e-add5-4273-b7bd-ac31912abec4 tempest-ServerRescueNegativeTestJSON-1367456352 tempest-ServerRescueNegativeTestJSON-1367456352-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:05:28Z,data_plane_status=None,description='',device_id='62c4a968-ecfa-4842-8cab-8aaeb7ca7a64',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=addc777a-4bdc-4153-92fa-8184c15d2cd1,mac_address=fa:16:3e:ab:01:5c,name='',network_id=b16f22e1-6fb1-440b-98eb-845123e960e6,numa_affinity_policy=,project_id='db72b63281384bd883b04d05bcc35677',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(addc777a-4bdc-4153-92fa-8184c15d2cd1),security_group_ids=set([258c239a-16c7-45ea-bf27-4f76d118a726]),status='DOWN',updated_at=2022-09-04T01:05:29Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:30.935462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b9d2dd3e-add5-4273-b7bd-ac31912abec4 tempest-ServerRescueNegativeTestJSON-1367456352 tempest-ServerRescueNegativeTestJSON-1367456352-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (addc777a-4bdc-4153-92fa-8184c15d2cd1), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:30.936185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-b9d2dd3e-add5-4273-b7bd-ac31912abec4 tempest-ServerRescueNegativeTestJSON-1367456352 tempest-ServerRescueNegativeTestJSON-1367456352-project] Security group member updated {'258c239a-16c7-45ea-bf27-4f76d118a726'} Sep 04 01:05:31.063769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-7b471ae6-c435-45c4-a0cc-8878748e88b5 service neutron] Resource Port 5d2b3e83-c7f4-4359-8491-abf0d6e3eec3 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=5d2b3e83-c7f4-4359-8491-abf0d6e3eec3,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=5d2b3e83-c7f4-4359-8491-abf0d6e3eec3,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=5d2b3e83-c7f4-4359-8491-abf0d6e3eec3,segment=NetworkSegment(fa03338c-c7bc-4666-a251-ff3dadbd2af6),segment_id=fa03338c-c7bc-4666-a251-ff3dadbd2af6)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:05:31.064567 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-7b471ae6-c435-45c4-a0cc-8878748e88b5 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (5d2b3e83-c7f4-4359-8491-abf0d6e3eec3), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:31.500623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-bed252c1-06db-462d-bf24-11ca80e0d6be None None] Resource Port f38c3884-111a-49d9-bcf1-6a965ff5e110 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=f38c3884-111a-49d9-bcf1-6a965ff5e110,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=f38c3884-111a-49d9-bcf1-6a965ff5e110,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:05:31.508741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-bed252c1-06db-462d-bf24-11ca80e0d6be None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (f38c3884-111a-49d9-bcf1-6a965ff5e110), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:31.724900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-929f2e06-0d40-4f00-b3d2-76becf152329 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:05:29Z,description='Default security group',id=08140fe8-c26d-469a-89a6-bfe7df4ccf7e,is_default=True,name='default',project_id='955511478fc2489e9f057dbf13bf3fc2',revision_number=1,rules=[SecurityGroupRule(d7f393ce-f607-4714-936c-ab14af043ae9),SecurityGroupRule(ed1a83e0-aa42-482d-9c4b-1dc5915637bb),SecurityGroupRule(fa008c6c-7d34-4bd3-a2fe-cb5f6667dc48),SecurityGroupRule(fb7f322c-9d3b-4328-8bfa-a91b3db7c8f3)],shared=False,stateful=True,updated_at=2022-09-04T01:05:30Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:31.725445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-929f2e06-0d40-4f00-b3d2-76becf152329 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (08140fe8-c26d-469a-89a6-bfe7df4ccf7e), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:31.726303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-929f2e06-0d40-4f00-b3d2-76becf152329 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:05:30Z,description=,direction='ingress',ethertype='IPv4',id=d7f393ce-f607-4714-936c-ab14af043ae9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='955511478fc2489e9f057dbf13bf3fc2',protocol=,remote_address_group_id=,remote_group_id=08140fe8-c26d-469a-89a6-bfe7df4ccf7e,remote_ip_prefix=,revision_number=0,security_group_id=08140fe8-c26d-469a-89a6-bfe7df4ccf7e,updated_at=2022-09-04T01:05:30Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:31.726699 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-929f2e06-0d40-4f00-b3d2-76becf152329 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (d7f393ce-f607-4714-936c-ab14af043ae9), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:31.727000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-929f2e06-0d40-4f00-b3d2-76becf152329 admin admin] Security group rule updated ['08140fe8-c26d-469a-89a6-bfe7df4ccf7e'] Sep 04 01:05:31.727728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-929f2e06-0d40-4f00-b3d2-76becf152329 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:05:30Z,description=,direction='ingress',ethertype='IPv6',id=ed1a83e0-aa42-482d-9c4b-1dc5915637bb,normalized_cidr=None,port_range_max=,port_range_min=,project_id='955511478fc2489e9f057dbf13bf3fc2',protocol=,remote_address_group_id=,remote_group_id=08140fe8-c26d-469a-89a6-bfe7df4ccf7e,remote_ip_prefix=,revision_number=0,security_group_id=08140fe8-c26d-469a-89a6-bfe7df4ccf7e,updated_at=2022-09-04T01:05:30Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:31.728088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-929f2e06-0d40-4f00-b3d2-76becf152329 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (ed1a83e0-aa42-482d-9c4b-1dc5915637bb), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:31.728420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-929f2e06-0d40-4f00-b3d2-76becf152329 admin admin] Security group rule updated ['08140fe8-c26d-469a-89a6-bfe7df4ccf7e'] Sep 04 01:05:31.729343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-929f2e06-0d40-4f00-b3d2-76becf152329 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:05:30Z,description=,direction='egress',ethertype='IPv4',id=fa008c6c-7d34-4bd3-a2fe-cb5f6667dc48,normalized_cidr=None,port_range_max=,port_range_min=,project_id='955511478fc2489e9f057dbf13bf3fc2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=08140fe8-c26d-469a-89a6-bfe7df4ccf7e,updated_at=2022-09-04T01:05:30Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:31.729624 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-929f2e06-0d40-4f00-b3d2-76becf152329 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (fa008c6c-7d34-4bd3-a2fe-cb5f6667dc48), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:31.729959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-929f2e06-0d40-4f00-b3d2-76becf152329 admin admin] Security group rule updated ['08140fe8-c26d-469a-89a6-bfe7df4ccf7e'] Sep 04 01:05:31.730656 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-929f2e06-0d40-4f00-b3d2-76becf152329 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:05:30Z,description=,direction='egress',ethertype='IPv6',id=fb7f322c-9d3b-4328-8bfa-a91b3db7c8f3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='955511478fc2489e9f057dbf13bf3fc2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=08140fe8-c26d-469a-89a6-bfe7df4ccf7e,updated_at=2022-09-04T01:05:30Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:31.731017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-929f2e06-0d40-4f00-b3d2-76becf152329 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (fb7f322c-9d3b-4328-8bfa-a91b3db7c8f3), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:31.731345 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-929f2e06-0d40-4f00-b3d2-76becf152329 admin admin] Security group rule updated ['08140fe8-c26d-469a-89a6-bfe7df4ccf7e'] Sep 04 01:05:32.191895 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-bed252c1-06db-462d-bf24-11ca80e0d6be None None] Resource Port f38c3884-111a-49d9-bcf1-6a965ff5e110 updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=f38c3884-111a-49d9-bcf1-6a965ff5e110,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=f38c3884-111a-49d9-bcf1-6a965ff5e110,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=f38c3884-111a-49d9-bcf1-6a965ff5e110,segment=NetworkSegment(c1d2cfbc-d3d5-4bd8-9da5-bc22dc7bb131),segment_id=c1d2cfbc-d3d5-4bd8-9da5-bc22dc7bb131)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:05:32.192564 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-bed252c1-06db-462d-bf24-11ca80e0d6be None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (f38c3884-111a-49d9-bcf1-6a965ff5e110), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:32.193985 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:261 started Sep 04 01:05:32.202761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade550d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=588000000,duration_sec=541,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:05:32.206304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:05:32.208314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:261 - starting polling. Elapsed:0.014 Sep 04 01:05:32.216594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:32.227505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:261 - port information retrieved. Elapsed:0.033 Sep 04 01:05:32.227900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Starting to process devices in:{'current': {'9b82da41-d694-43b0-a43b-5998addaf0bf', '3c278ab2-dc61-40f8-ab29-c8cc8b740d7d', 'c2f724af-5dbd-4d91-83cd-c5152b744599', 'a6788698-0516-4d8a-8fe8-2add6e7f6e94', 'f38c3884-111a-49d9-bcf1-6a965ff5e110', 'a62a40a2-96f5-427a-808e-9e63c8644245', '3fa24970-97a7-4f46-ac55-0b24323fa402', '0a1a9f7e-73de-4620-ae03-4b1d50d7f706', '3045b911-01c5-4fc3-8e89-ac2d9cea12a8', '89aa06b4-bbf1-40c2-bb48-500c3aecdf48', '6771cbc4-3e4b-419f-b87f-2db662f6e010', '4ed942cd-0f45-4d77-a66d-1d6c875877dc', 'f45b435f-0f64-41fe-a6ec-36683da765f9', '53e7a39c-e9ce-45c4-84af-632f2aac70ae', '378bbdd4-3077-4657-8055-fdc0a7600948', '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', 'dd44c60a-dd0f-4ff2-85ae-8c012af89cf9', '1cf499fb-10a0-4af2-afec-5f610dc85da6', 'ca102ce7-433c-4029-aabf-33d944165ff1'}, 'added': set(), 'removed': set(), 'updated': {'f38c3884-111a-49d9-bcf1-6a965ff5e110'}, 're_added': set()} {{(pid=107812) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 04 01:05:32.228477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': 'f38c3884-111a-49d9-bcf1-6a965ff5e110', 'device_id': '61883c33-5f31-4a53-b117-0fe975bce512', 'network_id': 'b16f22e1-6fb1-440b-98eb-845123e960e6', 'port_id': 'f38c3884-111a-49d9-bcf1-6a965ff5e110', 'mac_address': 'fa:16:3e:62:0b:90', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 174, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '35ea244b-d6a3-4c9a-a9b3-3f9d2814dee0', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 01:05:32.231904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: f38c3884-111a-49d9-bcf1-6a965ff5e110 {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:05:32.246549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port f38c3884-111a-49d9-bcf1-6a965ff5e110 updated. Details: {'device': 'f38c3884-111a-49d9-bcf1-6a965ff5e110', 'device_id': '61883c33-5f31-4a53-b117-0fe975bce512', 'network_id': 'b16f22e1-6fb1-440b-98eb-845123e960e6', 'port_id': 'f38c3884-111a-49d9-bcf1-6a965ff5e110', 'mac_address': 'fa:16:3e:62:0b:90', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 174, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '35ea244b-d6a3-4c9a-a9b3-3f9d2814dee0', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 7} Sep 04 01:05:32.247054 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-f38c3884-11, col_values=(('tag', 7),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:32.247425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-f38c3884-11, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:32.247867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-f38c3884-11, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:32.273152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-f38c3884-11, col_values=(('other_config', {'net_uuid': 'b16f22e1-6fb1-440b-98eb-845123e960e6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '7', 'segmentation_id': '174'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:32.334128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade550f,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 16}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:05:32.334785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:261 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 19 devices currently available. Time elapsed: 0.106 Sep 04 01:05:32.334904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Refreshing firewall for 1 devices {{(pid=107812) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 04 01:05:32.335092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Refresh firewall rules Sep 04 01:05:32.336421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information for ports dict_keys([]) {{(pid=107812) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 04 01:05:32.336710 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information {{(pid=107812) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 04 01:05:32.347248 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 2 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:05:32.456923 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f291b64-6de1-4f90-b3fe-7dbf79e3f9e8]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:05:32.457576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:261 - agent port security group processed in 0.229 Sep 04 01:05:32.458606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for f38c3884-111a-49d9-bcf1-6a965ff5e110 to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 01:05:32.906583 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4cb62115-befc-437f-8514-7bbb658b25c4 admin admin] Resource SecurityGroup deleted: e8b668b4-bea8-4d8c-a255-407d62d73cce {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:32.908515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4cb62115-befc-437f-8514-7bbb658b25c4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (e8b668b4-bea8-4d8c-a255-407d62d73cce), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:32.913503 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cb62115-befc-437f-8514-7bbb658b25c4 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('e8b668b4-bea8-4d8c-a255-407d62d73cce',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:05:33.063382 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4cb62115-befc-437f-8514-7bbb658b25c4 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('e8b668b4-bea8-4d8c-a255-407d62d73cce',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:05:33.063382 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4cb62115-befc-437f-8514-7bbb658b25c4 admin admin] Resource SecurityGroupRule deleted: 36011279-d672-4fd2-ad35-c9417c3ffd84 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:33.063382 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4cb62115-befc-437f-8514-7bbb658b25c4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (36011279-d672-4fd2-ad35-c9417c3ffd84), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:33.063382 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-4cb62115-befc-437f-8514-7bbb658b25c4 admin admin] Security group rule updated ['e8b668b4-bea8-4d8c-a255-407d62d73cce'] Sep 04 01:05:33.063382 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4cb62115-befc-437f-8514-7bbb658b25c4 admin admin] Resource SecurityGroupRule deleted: 3e0a9519-396e-472e-af77-616ce29eccef {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:33.064400 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4cb62115-befc-437f-8514-7bbb658b25c4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (3e0a9519-396e-472e-af77-616ce29eccef), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:33.064400 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-4cb62115-befc-437f-8514-7bbb658b25c4 admin admin] Security group rule updated ['e8b668b4-bea8-4d8c-a255-407d62d73cce'] Sep 04 01:05:33.064400 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4cb62115-befc-437f-8514-7bbb658b25c4 admin admin] Resource SecurityGroupRule deleted: a891bf9e-513c-456a-b5d0-c9c353420b62 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:33.064400 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4cb62115-befc-437f-8514-7bbb658b25c4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (a891bf9e-513c-456a-b5d0-c9c353420b62), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:33.064400 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-4cb62115-befc-437f-8514-7bbb658b25c4 admin admin] Security group rule updated ['e8b668b4-bea8-4d8c-a255-407d62d73cce'] Sep 04 01:05:33.067151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4cb62115-befc-437f-8514-7bbb658b25c4 admin admin] Resource SecurityGroupRule deleted: f4fe0bce-a64c-4c7d-9176-fc67aa715f1d {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:33.067151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4cb62115-befc-437f-8514-7bbb658b25c4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (f4fe0bce-a64c-4c7d-9176-fc67aa715f1d), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:33.067151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-4cb62115-befc-437f-8514-7bbb658b25c4 admin admin] Security group rule updated ['e8b668b4-bea8-4d8c-a255-407d62d73cce'] Sep 04 01:05:33.374774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Configuration for devices up ['f38c3884-111a-49d9-bcf1-6a965ff5e110'] and devices down [] completed. Sep 04 01:05:33.375095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:261 - ports processed. Elapsed:1.181 Sep 04 01:05:33.375433 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:261 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:1.181 Sep 04 01:05:33.449897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Resource Port f38c3884-111a-49d9-bcf1-6a965ff5e110 updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:05:33.451109 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (f38c3884-111a-49d9-bcf1-6a965ff5e110), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:33.580966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-3b91f38e-0bc3-462c-9973-a096f1e160ac service neutron] Resource Port 28efc83e-9838-45a7-9fd3-3625eeff4b09 updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=28efc83e-9838-45a7-9fd3-3625eeff4b09,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=28efc83e-9838-45a7-9fd3-3625eeff4b09,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:05:33.582554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-3b91f38e-0bc3-462c-9973-a096f1e160ac service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (28efc83e-9838-45a7-9fd3-3625eeff4b09), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:33.667108 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-6bda37e6-b753-46f1-85df-73eb4f66947c admin admin] Resource SecurityGroup deleted: 08140fe8-c26d-469a-89a6-bfe7df4ccf7e {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:33.670103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-6bda37e6-b753-46f1-85df-73eb4f66947c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (08140fe8-c26d-469a-89a6-bfe7df4ccf7e), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:33.670103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bda37e6-b753-46f1-85df-73eb4f66947c admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('08140fe8-c26d-469a-89a6-bfe7df4ccf7e',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:05:33.704481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-6bda37e6-b753-46f1-85df-73eb4f66947c admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('08140fe8-c26d-469a-89a6-bfe7df4ccf7e',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:05:33.704837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-6bda37e6-b753-46f1-85df-73eb4f66947c admin admin] Resource SecurityGroupRule deleted: d7f393ce-f607-4714-936c-ab14af043ae9 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:33.705464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-6bda37e6-b753-46f1-85df-73eb4f66947c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (d7f393ce-f607-4714-936c-ab14af043ae9), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:33.706771 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-6bda37e6-b753-46f1-85df-73eb4f66947c admin admin] Security group rule updated ['08140fe8-c26d-469a-89a6-bfe7df4ccf7e'] Sep 04 01:05:33.708047 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-6bda37e6-b753-46f1-85df-73eb4f66947c admin admin] Resource SecurityGroupRule deleted: ed1a83e0-aa42-482d-9c4b-1dc5915637bb {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:33.714031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-6bda37e6-b753-46f1-85df-73eb4f66947c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (ed1a83e0-aa42-482d-9c4b-1dc5915637bb), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:33.714752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-6bda37e6-b753-46f1-85df-73eb4f66947c admin admin] Security group rule updated ['08140fe8-c26d-469a-89a6-bfe7df4ccf7e'] Sep 04 01:05:33.715459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-6bda37e6-b753-46f1-85df-73eb4f66947c admin admin] Resource SecurityGroupRule deleted: fa008c6c-7d34-4bd3-a2fe-cb5f6667dc48 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:33.716035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-6bda37e6-b753-46f1-85df-73eb4f66947c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (fa008c6c-7d34-4bd3-a2fe-cb5f6667dc48), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:33.716576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-6bda37e6-b753-46f1-85df-73eb4f66947c admin admin] Security group rule updated ['08140fe8-c26d-469a-89a6-bfe7df4ccf7e'] Sep 04 01:05:33.718144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-6bda37e6-b753-46f1-85df-73eb4f66947c admin admin] Resource SecurityGroupRule deleted: fb7f322c-9d3b-4328-8bfa-a91b3db7c8f3 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:33.718728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-6bda37e6-b753-46f1-85df-73eb4f66947c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (fb7f322c-9d3b-4328-8bfa-a91b3db7c8f3), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:33.719795 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-6bda37e6-b753-46f1-85df-73eb4f66947c admin admin] Security group rule updated ['08140fe8-c26d-469a-89a6-bfe7df4ccf7e'] Sep 04 01:05:33.902881 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-7efd2e59-75f3-4031-9617-44f04c1b0fc5 service neutron] Resource Port addc777a-4bdc-4153-92fa-8184c15d2cd1 updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=addc777a-4bdc-4153-92fa-8184c15d2cd1,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=addc777a-4bdc-4153-92fa-8184c15d2cd1,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:05:33.902881 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-7efd2e59-75f3-4031-9617-44f04c1b0fc5 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (addc777a-4bdc-4153-92fa-8184c15d2cd1), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:34.195001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:262 started Sep 04 01:05:34.199272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5511,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=590000000,duration_sec=543,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:05:34.200683 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:05:34.201404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:262 - starting polling. Elapsed:0.006 Sep 04 01:05:34.204690 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:34.226786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:262 - port information retrieved. Elapsed:0.032 Sep 04 01:05:34.236609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Starting to process devices in:{'current': {'9b82da41-d694-43b0-a43b-5998addaf0bf', '3c278ab2-dc61-40f8-ab29-c8cc8b740d7d', 'c2f724af-5dbd-4d91-83cd-c5152b744599', 'a6788698-0516-4d8a-8fe8-2add6e7f6e94', 'f38c3884-111a-49d9-bcf1-6a965ff5e110', 'a62a40a2-96f5-427a-808e-9e63c8644245', '3fa24970-97a7-4f46-ac55-0b24323fa402', '0a1a9f7e-73de-4620-ae03-4b1d50d7f706', '3045b911-01c5-4fc3-8e89-ac2d9cea12a8', '89aa06b4-bbf1-40c2-bb48-500c3aecdf48', '6771cbc4-3e4b-419f-b87f-2db662f6e010', '4ed942cd-0f45-4d77-a66d-1d6c875877dc', 'f45b435f-0f64-41fe-a6ec-36683da765f9', '53e7a39c-e9ce-45c4-84af-632f2aac70ae', '378bbdd4-3077-4657-8055-fdc0a7600948', '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', 'dd44c60a-dd0f-4ff2-85ae-8c012af89cf9', '1cf499fb-10a0-4af2-afec-5f610dc85da6', 'ca102ce7-433c-4029-aabf-33d944165ff1'}, 'added': set(), 'removed': set(), 'updated': {'f38c3884-111a-49d9-bcf1-6a965ff5e110'}, 're_added': set()} {{(pid=107812) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 04 01:05:34.242317 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': 'f38c3884-111a-49d9-bcf1-6a965ff5e110', 'device_id': '61883c33-5f31-4a53-b117-0fe975bce512', 'network_id': 'b16f22e1-6fb1-440b-98eb-845123e960e6', 'port_id': 'f38c3884-111a-49d9-bcf1-6a965ff5e110', 'mac_address': 'fa:16:3e:62:0b:90', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 174, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '35ea244b-d6a3-4c9a-a9b3-3f9d2814dee0', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 01:05:34.246765 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: f38c3884-111a-49d9-bcf1-6a965ff5e110 {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:05:34.249526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port f38c3884-111a-49d9-bcf1-6a965ff5e110 updated. Details: {'device': 'f38c3884-111a-49d9-bcf1-6a965ff5e110', 'device_id': '61883c33-5f31-4a53-b117-0fe975bce512', 'network_id': 'b16f22e1-6fb1-440b-98eb-845123e960e6', 'port_id': 'f38c3884-111a-49d9-bcf1-6a965ff5e110', 'mac_address': 'fa:16:3e:62:0b:90', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 174, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '35ea244b-d6a3-4c9a-a9b3-3f9d2814dee0', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 7} Sep 04 01:05:34.251087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-f38c3884-11, col_values=(('tag', 7),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:34.252417 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-f38c3884-11, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:34.253980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-f38c3884-11, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:34.258063 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 01:05:34.265040 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-f38c3884-11, col_values=(('other_config', {'net_uuid': 'b16f22e1-6fb1-440b-98eb-845123e960e6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '174', 'tag': '7'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:05:34.266940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 01:05:34.274781 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade5513,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 16}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:05:34.276711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:262 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 19 devices currently available. Time elapsed: 0.035 Sep 04 01:05:34.278823 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Refreshing firewall for 1 devices {{(pid=107812) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 04 01:05:34.279595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Refresh firewall rules Sep 04 01:05:34.284065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information for ports dict_keys([]) {{(pid=107812) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 04 01:05:34.284676 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information {{(pid=107812) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 04 01:05:34.306767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 2 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:05:34.371448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-3b91f38e-0bc3-462c-9973-a096f1e160ac service neutron] Resource Port 28efc83e-9838-45a7-9fd3-3625eeff4b09 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=28efc83e-9838-45a7-9fd3-3625eeff4b09,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=28efc83e-9838-45a7-9fd3-3625eeff4b09,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=28efc83e-9838-45a7-9fd3-3625eeff4b09,segment=NetworkSegment(c1d2cfbc-d3d5-4bd8-9da5-bc22dc7bb131),segment_id=c1d2cfbc-d3d5-4bd8-9da5-bc22dc7bb131)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:05:34.371978 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-3b91f38e-0bc3-462c-9973-a096f1e160ac service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (28efc83e-9838-45a7-9fd3-3625eeff4b09), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:34.453246 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[845bd0c3-b337-4512-9fbf-1ef17f621e63]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:05:34.453246 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:262 - agent port security group processed in 0.209 Sep 04 01:05:34.453246 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for f38c3884-111a-49d9-bcf1-6a965ff5e110 to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 01:05:35.012997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Configuration for devices up ['f38c3884-111a-49d9-bcf1-6a965ff5e110'] and devices down [] completed. Sep 04 01:05:35.013638 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:262 - ports processed. Elapsed:0.819 Sep 04 01:05:35.014207 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:262 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.819 Sep 04 01:05:35.304336 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-7efd2e59-75f3-4031-9617-44f04c1b0fc5 service neutron] Resource Port addc777a-4bdc-4153-92fa-8184c15d2cd1 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=addc777a-4bdc-4153-92fa-8184c15d2cd1,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=addc777a-4bdc-4153-92fa-8184c15d2cd1,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=addc777a-4bdc-4153-92fa-8184c15d2cd1,segment=NetworkSegment(c1d2cfbc-d3d5-4bd8-9da5-bc22dc7bb131),segment_id=c1d2cfbc-d3d5-4bd8-9da5-bc22dc7bb131)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:05:35.309024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-7efd2e59-75f3-4031-9617-44f04c1b0fc5 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (addc777a-4bdc-4153-92fa-8184c15d2cd1), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:36.196418 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:263 started Sep 04 01:05:36.205373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5515,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=591000000,duration_sec=545,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:05:36.215401 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:05:36.223508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:263 - starting polling. Elapsed:0.022 Sep 04 01:05:36.227452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:36.260394 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:263 - port information retrieved. Elapsed:0.064 Sep 04 01:05:36.260746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:263 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.065 Sep 04 01:05:36.424691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-58f02063-cf78-4220-8b70-8efb41d1c008 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:05:34Z,description='Default security group',id=099b954e-95b4-497a-b1e6-5edb0672a3d4,is_default=True,name='default',project_id='42233f43b574453eb16ec7c6c7437905',revision_number=1,rules=[SecurityGroupRule(53a21675-2714-4785-8376-d20dab83f389),SecurityGroupRule(9455b75a-7659-487f-b687-ce00f707abee),SecurityGroupRule(ac241d5a-5fab-4e56-ac3c-0c6ca1ca9262),SecurityGroupRule(ba167e3c-f90f-49cb-bde0-a725589f8408)],shared=False,stateful=True,updated_at=2022-09-04T01:05:34Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:36.426205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-58f02063-cf78-4220-8b70-8efb41d1c008 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (099b954e-95b4-497a-b1e6-5edb0672a3d4), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:36.427537 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-58f02063-cf78-4220-8b70-8efb41d1c008 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:05:34Z,description=,direction='egress',ethertype='IPv4',id=53a21675-2714-4785-8376-d20dab83f389,normalized_cidr=None,port_range_max=,port_range_min=,project_id='42233f43b574453eb16ec7c6c7437905',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=099b954e-95b4-497a-b1e6-5edb0672a3d4,updated_at=2022-09-04T01:05:34Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:36.428095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-58f02063-cf78-4220-8b70-8efb41d1c008 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (53a21675-2714-4785-8376-d20dab83f389), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:36.428695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-58f02063-cf78-4220-8b70-8efb41d1c008 admin admin] Security group rule updated ['099b954e-95b4-497a-b1e6-5edb0672a3d4'] Sep 04 01:05:36.429616 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-58f02063-cf78-4220-8b70-8efb41d1c008 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:05:35Z,description=,direction='egress',ethertype='IPv6',id=9455b75a-7659-487f-b687-ce00f707abee,normalized_cidr=None,port_range_max=,port_range_min=,project_id='42233f43b574453eb16ec7c6c7437905',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=099b954e-95b4-497a-b1e6-5edb0672a3d4,updated_at=2022-09-04T01:05:35Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:36.430160 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-58f02063-cf78-4220-8b70-8efb41d1c008 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (9455b75a-7659-487f-b687-ce00f707abee), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:36.430648 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-58f02063-cf78-4220-8b70-8efb41d1c008 admin admin] Security group rule updated ['099b954e-95b4-497a-b1e6-5edb0672a3d4'] Sep 04 01:05:36.431360 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-58f02063-cf78-4220-8b70-8efb41d1c008 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:05:34Z,description=,direction='ingress',ethertype='IPv4',id=ac241d5a-5fab-4e56-ac3c-0c6ca1ca9262,normalized_cidr=None,port_range_max=,port_range_min=,project_id='42233f43b574453eb16ec7c6c7437905',protocol=,remote_address_group_id=,remote_group_id=099b954e-95b4-497a-b1e6-5edb0672a3d4,remote_ip_prefix=,revision_number=0,security_group_id=099b954e-95b4-497a-b1e6-5edb0672a3d4,updated_at=2022-09-04T01:05:34Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:36.431720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-58f02063-cf78-4220-8b70-8efb41d1c008 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (ac241d5a-5fab-4e56-ac3c-0c6ca1ca9262), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:36.432052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-58f02063-cf78-4220-8b70-8efb41d1c008 admin admin] Security group rule updated ['099b954e-95b4-497a-b1e6-5edb0672a3d4'] Sep 04 01:05:36.436371 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-58f02063-cf78-4220-8b70-8efb41d1c008 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:05:34Z,description=,direction='ingress',ethertype='IPv6',id=ba167e3c-f90f-49cb-bde0-a725589f8408,normalized_cidr=None,port_range_max=,port_range_min=,project_id='42233f43b574453eb16ec7c6c7437905',protocol=,remote_address_group_id=,remote_group_id=099b954e-95b4-497a-b1e6-5edb0672a3d4,remote_ip_prefix=,revision_number=0,security_group_id=099b954e-95b4-497a-b1e6-5edb0672a3d4,updated_at=2022-09-04T01:05:34Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:36.436859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-58f02063-cf78-4220-8b70-8efb41d1c008 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (ba167e3c-f90f-49cb-bde0-a725589f8408), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:36.444622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-58f02063-cf78-4220-8b70-8efb41d1c008 admin admin] Security group rule updated ['099b954e-95b4-497a-b1e6-5edb0672a3d4'] Sep 04 01:05:36.921880 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-cba86765-c825-4657-a26e-7320cdff5ac8 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:05:36Z,description='Default security group',id=50c761f9-00c4-4d3a-bf88-110b8796b75f,is_default=True,name='default',project_id='d73d808e831f4d1a982b7f538a5853de',revision_number=1,rules=[SecurityGroupRule(1b2f8dbc-fafc-4e71-b014-b97af0cc1d6c),SecurityGroupRule(20f2ed4e-3073-499f-aa0b-b9fc6c6d1df3),SecurityGroupRule(3a4e5585-beb2-494d-84f7-bc13ac7fb3d7),SecurityGroupRule(6101ca76-ec2e-46f0-bdef-8bee43a23f0f)],shared=False,stateful=True,updated_at=2022-09-04T01:05:36Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:36.921880 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-cba86765-c825-4657-a26e-7320cdff5ac8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (50c761f9-00c4-4d3a-bf88-110b8796b75f), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:36.921880 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-cba86765-c825-4657-a26e-7320cdff5ac8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:05:36Z,description=,direction='egress',ethertype='IPv6',id=1b2f8dbc-fafc-4e71-b014-b97af0cc1d6c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d73d808e831f4d1a982b7f538a5853de',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=50c761f9-00c4-4d3a-bf88-110b8796b75f,updated_at=2022-09-04T01:05:36Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:36.922310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-cba86765-c825-4657-a26e-7320cdff5ac8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (1b2f8dbc-fafc-4e71-b014-b97af0cc1d6c), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:36.922310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-cba86765-c825-4657-a26e-7320cdff5ac8 admin admin] Security group rule updated ['50c761f9-00c4-4d3a-bf88-110b8796b75f'] Sep 04 01:05:36.922310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-cba86765-c825-4657-a26e-7320cdff5ac8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:05:36Z,description=,direction='egress',ethertype='IPv4',id=20f2ed4e-3073-499f-aa0b-b9fc6c6d1df3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d73d808e831f4d1a982b7f538a5853de',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=50c761f9-00c4-4d3a-bf88-110b8796b75f,updated_at=2022-09-04T01:05:36Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:36.922310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-cba86765-c825-4657-a26e-7320cdff5ac8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (20f2ed4e-3073-499f-aa0b-b9fc6c6d1df3), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:36.922611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-cba86765-c825-4657-a26e-7320cdff5ac8 admin admin] Security group rule updated ['50c761f9-00c4-4d3a-bf88-110b8796b75f'] Sep 04 01:05:36.926439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-cba86765-c825-4657-a26e-7320cdff5ac8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:05:36Z,description=,direction='ingress',ethertype='IPv4',id=3a4e5585-beb2-494d-84f7-bc13ac7fb3d7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d73d808e831f4d1a982b7f538a5853de',protocol=,remote_address_group_id=,remote_group_id=50c761f9-00c4-4d3a-bf88-110b8796b75f,remote_ip_prefix=,revision_number=0,security_group_id=50c761f9-00c4-4d3a-bf88-110b8796b75f,updated_at=2022-09-04T01:05:36Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:36.926861 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-cba86765-c825-4657-a26e-7320cdff5ac8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (3a4e5585-beb2-494d-84f7-bc13ac7fb3d7), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:36.927219 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-cba86765-c825-4657-a26e-7320cdff5ac8 admin admin] Security group rule updated ['50c761f9-00c4-4d3a-bf88-110b8796b75f'] Sep 04 01:05:36.927937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-cba86765-c825-4657-a26e-7320cdff5ac8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:05:36Z,description=,direction='ingress',ethertype='IPv6',id=6101ca76-ec2e-46f0-bdef-8bee43a23f0f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d73d808e831f4d1a982b7f538a5853de',protocol=,remote_address_group_id=,remote_group_id=50c761f9-00c4-4d3a-bf88-110b8796b75f,remote_ip_prefix=,revision_number=0,security_group_id=50c761f9-00c4-4d3a-bf88-110b8796b75f,updated_at=2022-09-04T01:05:36Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:36.928291 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-cba86765-c825-4657-a26e-7320cdff5ac8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (6101ca76-ec2e-46f0-bdef-8bee43a23f0f), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:36.928619 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-cba86765-c825-4657-a26e-7320cdff5ac8 admin admin] Security group rule updated ['50c761f9-00c4-4d3a-bf88-110b8796b75f'] Sep 04 01:05:36.935451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-08bd6383-cdf0-4fdf-a6b7-bb64cd9a4e21 admin admin] Resource SecurityGroup deleted: 099b954e-95b4-497a-b1e6-5edb0672a3d4 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:36.935819 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-08bd6383-cdf0-4fdf-a6b7-bb64cd9a4e21 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (099b954e-95b4-497a-b1e6-5edb0672a3d4), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:36.936276 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08bd6383-cdf0-4fdf-a6b7-bb64cd9a4e21 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('099b954e-95b4-497a-b1e6-5edb0672a3d4',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:05:36.951874 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-08bd6383-cdf0-4fdf-a6b7-bb64cd9a4e21 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('099b954e-95b4-497a-b1e6-5edb0672a3d4',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:05:36.953308 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-08bd6383-cdf0-4fdf-a6b7-bb64cd9a4e21 admin admin] Resource SecurityGroupRule deleted: 53a21675-2714-4785-8376-d20dab83f389 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:36.953793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-08bd6383-cdf0-4fdf-a6b7-bb64cd9a4e21 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (53a21675-2714-4785-8376-d20dab83f389), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:36.954446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-08bd6383-cdf0-4fdf-a6b7-bb64cd9a4e21 admin admin] Security group rule updated ['099b954e-95b4-497a-b1e6-5edb0672a3d4'] Sep 04 01:05:36.955472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-08bd6383-cdf0-4fdf-a6b7-bb64cd9a4e21 admin admin] Resource SecurityGroupRule deleted: 9455b75a-7659-487f-b687-ce00f707abee {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:36.956018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-08bd6383-cdf0-4fdf-a6b7-bb64cd9a4e21 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (9455b75a-7659-487f-b687-ce00f707abee), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:36.956466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-08bd6383-cdf0-4fdf-a6b7-bb64cd9a4e21 admin admin] Security group rule updated ['099b954e-95b4-497a-b1e6-5edb0672a3d4'] Sep 04 01:05:36.957730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-08bd6383-cdf0-4fdf-a6b7-bb64cd9a4e21 admin admin] Resource SecurityGroupRule deleted: ac241d5a-5fab-4e56-ac3c-0c6ca1ca9262 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:36.958540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-08bd6383-cdf0-4fdf-a6b7-bb64cd9a4e21 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (ac241d5a-5fab-4e56-ac3c-0c6ca1ca9262), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:36.958974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-08bd6383-cdf0-4fdf-a6b7-bb64cd9a4e21 admin admin] Security group rule updated ['099b954e-95b4-497a-b1e6-5edb0672a3d4'] Sep 04 01:05:36.959491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-08bd6383-cdf0-4fdf-a6b7-bb64cd9a4e21 admin admin] Resource SecurityGroupRule deleted: ba167e3c-f90f-49cb-bde0-a725589f8408 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:36.960538 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-08bd6383-cdf0-4fdf-a6b7-bb64cd9a4e21 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (ba167e3c-f90f-49cb-bde0-a725589f8408), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:36.961164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-08bd6383-cdf0-4fdf-a6b7-bb64cd9a4e21 admin admin] Security group rule updated ['099b954e-95b4-497a-b1e6-5edb0672a3d4'] Sep 04 01:05:37.218611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-bd6dbac3-2ff1-4775-bbf5-4c4399dffb9d admin admin] Resource SecurityGroup deleted: 50c761f9-00c4-4d3a-bf88-110b8796b75f {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:37.224380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-bd6dbac3-2ff1-4775-bbf5-4c4399dffb9d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (50c761f9-00c4-4d3a-bf88-110b8796b75f), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:37.224380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd6dbac3-2ff1-4775-bbf5-4c4399dffb9d admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('50c761f9-00c4-4d3a-bf88-110b8796b75f',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:05:37.235117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-bd6dbac3-2ff1-4775-bbf5-4c4399dffb9d admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('50c761f9-00c4-4d3a-bf88-110b8796b75f',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:05:37.236897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-bd6dbac3-2ff1-4775-bbf5-4c4399dffb9d admin admin] Resource SecurityGroupRule deleted: 1b2f8dbc-fafc-4e71-b014-b97af0cc1d6c {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:37.237656 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-bd6dbac3-2ff1-4775-bbf5-4c4399dffb9d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (1b2f8dbc-fafc-4e71-b014-b97af0cc1d6c), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:37.238114 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-bd6dbac3-2ff1-4775-bbf5-4c4399dffb9d admin admin] Security group rule updated ['50c761f9-00c4-4d3a-bf88-110b8796b75f'] Sep 04 01:05:37.238662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-bd6dbac3-2ff1-4775-bbf5-4c4399dffb9d admin admin] Resource SecurityGroupRule deleted: 20f2ed4e-3073-499f-aa0b-b9fc6c6d1df3 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:37.239119 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-bd6dbac3-2ff1-4775-bbf5-4c4399dffb9d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (20f2ed4e-3073-499f-aa0b-b9fc6c6d1df3), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:37.239673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-bd6dbac3-2ff1-4775-bbf5-4c4399dffb9d admin admin] Security group rule updated ['50c761f9-00c4-4d3a-bf88-110b8796b75f'] Sep 04 01:05:37.240199 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-bd6dbac3-2ff1-4775-bbf5-4c4399dffb9d admin admin] Resource SecurityGroupRule deleted: 3a4e5585-beb2-494d-84f7-bc13ac7fb3d7 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:37.243155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-bd6dbac3-2ff1-4775-bbf5-4c4399dffb9d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (3a4e5585-beb2-494d-84f7-bc13ac7fb3d7), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:37.243821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-bd6dbac3-2ff1-4775-bbf5-4c4399dffb9d admin admin] Security group rule updated ['50c761f9-00c4-4d3a-bf88-110b8796b75f'] Sep 04 01:05:37.244918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-bd6dbac3-2ff1-4775-bbf5-4c4399dffb9d admin admin] Resource SecurityGroupRule deleted: 6101ca76-ec2e-46f0-bdef-8bee43a23f0f {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:37.245432 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-bd6dbac3-2ff1-4775-bbf5-4c4399dffb9d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (6101ca76-ec2e-46f0-bdef-8bee43a23f0f), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:37.246034 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-bd6dbac3-2ff1-4775-bbf5-4c4399dffb9d admin admin] Security group rule updated ['50c761f9-00c4-4d3a-bf88-110b8796b75f'] Sep 04 01:05:37.550165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-76f16b1d-dee6-4938-8145-14ffbf5a019e tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:05:36Z,data_plane_status=None,description='',device_id='d296b21a-c705-4d0b-8402-19a9c6f2e3d2',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=e9c83c9b-f295-4069-84cf-ff7c294ae4cd,mac_address=fa:16:3e:cc:71:55,name='',network_id=1fb5aed8-696d-4f87-8b2a-7d29744538a8,numa_affinity_policy=,project_id='e7dca68418a14d7da9aa63ac25f202e8',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(e9c83c9b-f295-4069-84cf-ff7c294ae4cd),security_group_ids=set([2a5bcd08-2f5c-4785-8968-f136b0051d59]),status='DOWN',updated_at=2022-09-04T01:05:37Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:37.550165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-76f16b1d-dee6-4938-8145-14ffbf5a019e tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (e9c83c9b-f295-4069-84cf-ff7c294ae4cd), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:37.551125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-76f16b1d-dee6-4938-8145-14ffbf5a019e tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Security group member updated {'2a5bcd08-2f5c-4785-8968-f136b0051d59'} Sep 04 01:05:38.201013 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:264 started Sep 04 01:05:38.209205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5517,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=595000000,duration_sec=547,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:05:38.209205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:05:38.209205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:264 - starting polling. Elapsed:0.006 Sep 04 01:05:38.211927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:38.216441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:264 - port information retrieved. Elapsed:0.016 Sep 04 01:05:38.217172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:264 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.016 Sep 04 01:05:40.202774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:265 started Sep 04 01:05:40.207511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5519,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=598000000,duration_sec=549,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:05:40.208282 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:05:40.208830 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:265 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 04 01:05:41.169683 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-04f01a9c-8a38-4ce5-a5b5-1d2ca3c1bd03 service neutron] Resource Port e9c83c9b-f295-4069-84cf-ff7c294ae4cd updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=e9c83c9b-f295-4069-84cf-ff7c294ae4cd,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=e9c83c9b-f295-4069-84cf-ff7c294ae4cd,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:05:41.170405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-04f01a9c-8a38-4ce5-a5b5-1d2ca3c1bd03 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (e9c83c9b-f295-4069-84cf-ff7c294ae4cd), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:41.414518 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-04f01a9c-8a38-4ce5-a5b5-1d2ca3c1bd03 service neutron] Resource Port e9c83c9b-f295-4069-84cf-ff7c294ae4cd updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=e9c83c9b-f295-4069-84cf-ff7c294ae4cd,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=e9c83c9b-f295-4069-84cf-ff7c294ae4cd,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=e9c83c9b-f295-4069-84cf-ff7c294ae4cd,segment=NetworkSegment(79b84dcb-99f6-4af2-ac73-30fcaae597f6),segment_id=79b84dcb-99f6-4af2-ac73-30fcaae597f6)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:05:41.415161 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-04f01a9c-8a38-4ce5-a5b5-1d2ca3c1bd03 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (e9c83c9b-f295-4069-84cf-ff7c294ae4cd), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:42.204039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:266 started Sep 04 01:05:42.206486 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade551b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=598000000,duration_sec=551,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:05:42.207070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:05:42.207511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:266 - starting polling. Elapsed:0.004 Sep 04 01:05:42.210064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:42.213516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:266 - port information retrieved. Elapsed:0.010 Sep 04 01:05:42.219120 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:266 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Sep 04 01:05:44.204868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:267 started Sep 04 01:05:44.208907 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade551d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=600000000,duration_sec=553,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:05:44.209908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:05:44.210257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:267 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 04 01:05:44.987847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Resource Port 5d2b3e83-c7f4-4359-8491-abf0d6e3eec3 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:05:44.988273 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (5d2b3e83-c7f4-4359-8491-abf0d6e3eec3), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:46.206287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:268 started Sep 04 01:05:46.208812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade551f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=600000000,duration_sec=555,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:05:46.209404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:05:46.209730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:268 - starting polling. Elapsed:0.004 Sep 04 01:05:46.212299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:46.216180 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:268 - port information retrieved. Elapsed:0.010 Sep 04 01:05:46.216490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:268 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Sep 04 01:05:48.066105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-e20f7388-bcb7-4ccd-8485-30abbc5e8487 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:05:47Z,description='Default security group',id=53f60291-ab82-4684-89f5-089e2198bffa,is_default=True,name='default',project_id='7eb1a3a92ce841f4a6955bc13a3bc6e0',revision_number=1,rules=[SecurityGroupRule(35ea4669-4633-48d6-b97d-28f2b63a072a),SecurityGroupRule(5c0d21e6-7ad0-4caa-81de-b5485f7a03b0),SecurityGroupRule(bdda355f-7a40-4ed4-9ab4-0cae6d5b0d5e),SecurityGroupRule(fc4a30dd-92cd-4114-b31e-a861ae5de178)],shared=False,stateful=True,updated_at=2022-09-04T01:05:47Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:48.066745 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-e20f7388-bcb7-4ccd-8485-30abbc5e8487 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (53f60291-ab82-4684-89f5-089e2198bffa), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:48.067201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-e20f7388-bcb7-4ccd-8485-30abbc5e8487 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:05:47Z,description=,direction='egress',ethertype='IPv6',id=35ea4669-4633-48d6-b97d-28f2b63a072a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7eb1a3a92ce841f4a6955bc13a3bc6e0',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=53f60291-ab82-4684-89f5-089e2198bffa,updated_at=2022-09-04T01:05:47Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:48.067600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-e20f7388-bcb7-4ccd-8485-30abbc5e8487 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (35ea4669-4633-48d6-b97d-28f2b63a072a), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:48.068194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-e20f7388-bcb7-4ccd-8485-30abbc5e8487 admin admin] Security group rule updated ['53f60291-ab82-4684-89f5-089e2198bffa'] Sep 04 01:05:48.069109 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-e20f7388-bcb7-4ccd-8485-30abbc5e8487 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:05:47Z,description=,direction='egress',ethertype='IPv4',id=5c0d21e6-7ad0-4caa-81de-b5485f7a03b0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7eb1a3a92ce841f4a6955bc13a3bc6e0',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=53f60291-ab82-4684-89f5-089e2198bffa,updated_at=2022-09-04T01:05:47Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:48.069571 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-e20f7388-bcb7-4ccd-8485-30abbc5e8487 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (5c0d21e6-7ad0-4caa-81de-b5485f7a03b0), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:48.070038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-e20f7388-bcb7-4ccd-8485-30abbc5e8487 admin admin] Security group rule updated ['53f60291-ab82-4684-89f5-089e2198bffa'] Sep 04 01:05:48.070821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-e20f7388-bcb7-4ccd-8485-30abbc5e8487 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:05:47Z,description=,direction='ingress',ethertype='IPv6',id=bdda355f-7a40-4ed4-9ab4-0cae6d5b0d5e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7eb1a3a92ce841f4a6955bc13a3bc6e0',protocol=,remote_address_group_id=,remote_group_id=53f60291-ab82-4684-89f5-089e2198bffa,remote_ip_prefix=,revision_number=0,security_group_id=53f60291-ab82-4684-89f5-089e2198bffa,updated_at=2022-09-04T01:05:47Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:48.071200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-e20f7388-bcb7-4ccd-8485-30abbc5e8487 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (bdda355f-7a40-4ed4-9ab4-0cae6d5b0d5e), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:48.072352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-e20f7388-bcb7-4ccd-8485-30abbc5e8487 admin admin] Security group rule updated ['53f60291-ab82-4684-89f5-089e2198bffa'] Sep 04 01:05:48.073198 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-e20f7388-bcb7-4ccd-8485-30abbc5e8487 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:05:47Z,description=,direction='ingress',ethertype='IPv4',id=fc4a30dd-92cd-4114-b31e-a861ae5de178,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7eb1a3a92ce841f4a6955bc13a3bc6e0',protocol=,remote_address_group_id=,remote_group_id=53f60291-ab82-4684-89f5-089e2198bffa,remote_ip_prefix=,revision_number=0,security_group_id=53f60291-ab82-4684-89f5-089e2198bffa,updated_at=2022-09-04T01:05:47Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:48.073590 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-e20f7388-bcb7-4ccd-8485-30abbc5e8487 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (fc4a30dd-92cd-4114-b31e-a861ae5de178), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:48.073925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-e20f7388-bcb7-4ccd-8485-30abbc5e8487 admin admin] Security group rule updated ['53f60291-ab82-4684-89f5-089e2198bffa'] Sep 04 01:05:48.207596 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:269 started Sep 04 01:05:48.211310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5521,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=603000000,duration_sec=557,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:05:48.211911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:05:48.212264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:269 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 04 01:05:48.278264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Resource Port 5d2b3e83-c7f4-4359-8491-abf0d6e3eec3 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:05:48.278953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (5d2b3e83-c7f4-4359-8491-abf0d6e3eec3), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:48.341507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Resource Port 28efc83e-9838-45a7-9fd3-3625eeff4b09 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:05:48.342261 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (28efc83e-9838-45a7-9fd3-3625eeff4b09), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:48.584833 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-472993a6-9f21-4eb3-93b2-d4afb4727fff tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:05:46Z,data_plane_status=None,description='',device_id='784b2b9b-9890-4f9e-be75-2548b520e138',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=e0a049e7-02dc-4e07-af75-3de7fbe36b23,mac_address=fa:16:3e:d4:a5:7e,name='',network_id=d7f39628-666e-4480-8bee-49de183d5e09,numa_affinity_policy=,project_id='287d111f08ac4b05bd5adec9c40d0620',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(e0a049e7-02dc-4e07-af75-3de7fbe36b23),security_group_ids=set([f1cdaab5-9805-40c3-b794-76bf42b9b813]),status='DOWN',updated_at=2022-09-04T01:05:47Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:48.585257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-472993a6-9f21-4eb3-93b2-d4afb4727fff tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (e0a049e7-02dc-4e07-af75-3de7fbe36b23), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:48.585933 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-472993a6-9f21-4eb3-93b2-d4afb4727fff tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Security group member updated {'f1cdaab5-9805-40c3-b794-76bf42b9b813'} Sep 04 01:05:48.770454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-800218ef-366d-48d1-8780-9c75f0594c89 admin admin] Resource SecurityGroup deleted: 53f60291-ab82-4684-89f5-089e2198bffa {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:48.771059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-800218ef-366d-48d1-8780-9c75f0594c89 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (53f60291-ab82-4684-89f5-089e2198bffa), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:48.771762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-800218ef-366d-48d1-8780-9c75f0594c89 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('53f60291-ab82-4684-89f5-089e2198bffa',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:05:48.789924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-800218ef-366d-48d1-8780-9c75f0594c89 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('53f60291-ab82-4684-89f5-089e2198bffa',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:05:48.790490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-800218ef-366d-48d1-8780-9c75f0594c89 admin admin] Resource SecurityGroupRule deleted: 35ea4669-4633-48d6-b97d-28f2b63a072a {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:48.790852 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-800218ef-366d-48d1-8780-9c75f0594c89 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (35ea4669-4633-48d6-b97d-28f2b63a072a), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:48.791188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-800218ef-366d-48d1-8780-9c75f0594c89 admin admin] Security group rule updated ['53f60291-ab82-4684-89f5-089e2198bffa'] Sep 04 01:05:48.791621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-800218ef-366d-48d1-8780-9c75f0594c89 admin admin] Resource SecurityGroupRule deleted: 5c0d21e6-7ad0-4caa-81de-b5485f7a03b0 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:48.791965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-800218ef-366d-48d1-8780-9c75f0594c89 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (5c0d21e6-7ad0-4caa-81de-b5485f7a03b0), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:48.792295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-800218ef-366d-48d1-8780-9c75f0594c89 admin admin] Security group rule updated ['53f60291-ab82-4684-89f5-089e2198bffa'] Sep 04 01:05:48.793594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-800218ef-366d-48d1-8780-9c75f0594c89 admin admin] Resource SecurityGroupRule deleted: bdda355f-7a40-4ed4-9ab4-0cae6d5b0d5e {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:48.793946 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-800218ef-366d-48d1-8780-9c75f0594c89 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (bdda355f-7a40-4ed4-9ab4-0cae6d5b0d5e), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:48.794780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-800218ef-366d-48d1-8780-9c75f0594c89 admin admin] Security group rule updated ['53f60291-ab82-4684-89f5-089e2198bffa'] Sep 04 01:05:48.795226 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-800218ef-366d-48d1-8780-9c75f0594c89 admin admin] Resource SecurityGroupRule deleted: fc4a30dd-92cd-4114-b31e-a861ae5de178 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:05:48.795602 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-800218ef-366d-48d1-8780-9c75f0594c89 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (fc4a30dd-92cd-4114-b31e-a861ae5de178), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:48.796325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-800218ef-366d-48d1-8780-9c75f0594c89 admin admin] Security group rule updated ['53f60291-ab82-4684-89f5-089e2198bffa'] Sep 04 01:05:49.241420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-dd07b92b-e20f-4928-b100-c756473aebaa tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:05:48Z,data_plane_status=None,description='',device_id='49be5a0b-f748-486e-a546-c07a8e8451a3',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=fcbc60fd-1785-4f94-9436-a520ec06cdaf,mac_address=fa:16:3e:e5:41:43,name='',network_id=3e702e6e-ebe1-46a7-b30d-f3d140ac2993,numa_affinity_policy=,project_id='55faed42b7f243df9df879d581797f56',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(fcbc60fd-1785-4f94-9436-a520ec06cdaf),security_group_ids=set([28889e15-3fb7-44d1-a902-1d3272393b5a]),status='DOWN',updated_at=2022-09-04T01:05:48Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:49.241420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-dd07b92b-e20f-4928-b100-c756473aebaa tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (fcbc60fd-1785-4f94-9436-a520ec06cdaf), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:49.242136 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-dd07b92b-e20f-4928-b100-c756473aebaa tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Security group member updated {'28889e15-3fb7-44d1-a902-1d3272393b5a'} Sep 04 01:05:50.208980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:270 started Sep 04 01:05:50.211621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5523,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=603000000,duration_sec=559,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:05:50.212184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:05:50.212502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:270 - starting polling. Elapsed:0.004 Sep 04 01:05:50.217833 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:50.222411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:270 - port information retrieved. Elapsed:0.014 Sep 04 01:05:50.222862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:270 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.014 Sep 04 01:05:51.647309 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Resource Port addc777a-4bdc-4153-92fa-8184c15d2cd1 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:05:51.647937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (addc777a-4bdc-4153-92fa-8184c15d2cd1), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:52.210478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:271 started Sep 04 01:05:52.213198 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5525,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=605000000,duration_sec=561,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:05:52.213796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:05:52.214125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:271 - starting polling. Elapsed:0.004 Sep 04 01:05:52.216811 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:52.220435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:271 - port information retrieved. Elapsed:0.010 Sep 04 01:05:52.221422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:271 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Sep 04 01:05:52.739301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Resource Port 28efc83e-9838-45a7-9fd3-3625eeff4b09 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:05:52.740455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (28efc83e-9838-45a7-9fd3-3625eeff4b09), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:53.248687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-97468d51-66d4-4eb2-a690-71a7b9de7db5 service neutron] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:05:52Z,description='Default security group',id=7efc4854-aefd-42f0-a3a7-d365531f0be4,is_default=True,name='default',project_id='b1f56314d44d4faaa88e735ea196783f',revision_number=1,rules=[SecurityGroupRule(5f493387-bbf3-4dd5-835c-30d36ffe8e23),SecurityGroupRule(80bfbc65-f68b-401e-a409-f7433cc10c00),SecurityGroupRule(8764ad16-3367-496c-9f21-a66ba0f5552f),SecurityGroupRule(a123027e-2f99-4392-9edf-65b0f9261618)],shared=False,stateful=True,updated_at=2022-09-04T01:05:52Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:53.249771 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-97468d51-66d4-4eb2-a690-71a7b9de7db5 service neutron] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (7efc4854-aefd-42f0-a3a7-d365531f0be4), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:53.250666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-97468d51-66d4-4eb2-a690-71a7b9de7db5 service neutron] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:05:52Z,description=,direction='ingress',ethertype='IPv4',id=5f493387-bbf3-4dd5-835c-30d36ffe8e23,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b1f56314d44d4faaa88e735ea196783f',protocol=,remote_address_group_id=,remote_group_id=7efc4854-aefd-42f0-a3a7-d365531f0be4,remote_ip_prefix=,revision_number=0,security_group_id=7efc4854-aefd-42f0-a3a7-d365531f0be4,updated_at=2022-09-04T01:05:52Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:53.251293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-97468d51-66d4-4eb2-a690-71a7b9de7db5 service neutron] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (5f493387-bbf3-4dd5-835c-30d36ffe8e23), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:53.251875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-97468d51-66d4-4eb2-a690-71a7b9de7db5 service neutron] Security group rule updated ['7efc4854-aefd-42f0-a3a7-d365531f0be4'] Sep 04 01:05:53.253747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-97468d51-66d4-4eb2-a690-71a7b9de7db5 service neutron] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:05:52Z,description=,direction='egress',ethertype='IPv4',id=80bfbc65-f68b-401e-a409-f7433cc10c00,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b1f56314d44d4faaa88e735ea196783f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=7efc4854-aefd-42f0-a3a7-d365531f0be4,updated_at=2022-09-04T01:05:52Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:53.254601 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-97468d51-66d4-4eb2-a690-71a7b9de7db5 service neutron] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (80bfbc65-f68b-401e-a409-f7433cc10c00), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:53.271633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-97468d51-66d4-4eb2-a690-71a7b9de7db5 service neutron] Security group rule updated ['7efc4854-aefd-42f0-a3a7-d365531f0be4'] Sep 04 01:05:53.272530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-97468d51-66d4-4eb2-a690-71a7b9de7db5 service neutron] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:05:52Z,description=,direction='egress',ethertype='IPv6',id=8764ad16-3367-496c-9f21-a66ba0f5552f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b1f56314d44d4faaa88e735ea196783f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=7efc4854-aefd-42f0-a3a7-d365531f0be4,updated_at=2022-09-04T01:05:52Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:53.274121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-97468d51-66d4-4eb2-a690-71a7b9de7db5 service neutron] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (8764ad16-3367-496c-9f21-a66ba0f5552f), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:53.274121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-97468d51-66d4-4eb2-a690-71a7b9de7db5 service neutron] Security group rule updated ['7efc4854-aefd-42f0-a3a7-d365531f0be4'] Sep 04 01:05:53.274859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-97468d51-66d4-4eb2-a690-71a7b9de7db5 service neutron] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:05:52Z,description=,direction='ingress',ethertype='IPv6',id=a123027e-2f99-4392-9edf-65b0f9261618,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b1f56314d44d4faaa88e735ea196783f',protocol=,remote_address_group_id=,remote_group_id=7efc4854-aefd-42f0-a3a7-d365531f0be4,remote_ip_prefix=,revision_number=0,security_group_id=7efc4854-aefd-42f0-a3a7-d365531f0be4,updated_at=2022-09-04T01:05:52Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:05:53.275233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-97468d51-66d4-4eb2-a690-71a7b9de7db5 service neutron] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (a123027e-2f99-4392-9edf-65b0f9261618), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:53.275568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-97468d51-66d4-4eb2-a690-71a7b9de7db5 service neutron] Security group rule updated ['7efc4854-aefd-42f0-a3a7-d365531f0be4'] Sep 04 01:05:53.585489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-9a979097-d688-42ea-aa27-3269d5c83da6 service neutron] Resource Port fcbc60fd-1785-4f94-9436-a520ec06cdaf updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=fcbc60fd-1785-4f94-9436-a520ec06cdaf,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=fcbc60fd-1785-4f94-9436-a520ec06cdaf,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:05:53.585877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-9a979097-d688-42ea-aa27-3269d5c83da6 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (fcbc60fd-1785-4f94-9436-a520ec06cdaf), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:53.725717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-3385d8c2-b8f7-405d-a818-af95a807eef6 service neutron] Resource Port e0a049e7-02dc-4e07-af75-3de7fbe36b23 updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=e0a049e7-02dc-4e07-af75-3de7fbe36b23,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=e0a049e7-02dc-4e07-af75-3de7fbe36b23,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:05:53.726428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-3385d8c2-b8f7-405d-a818-af95a807eef6 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (e0a049e7-02dc-4e07-af75-3de7fbe36b23), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:54.065972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-9a979097-d688-42ea-aa27-3269d5c83da6 service neutron] Resource Port fcbc60fd-1785-4f94-9436-a520ec06cdaf updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=fcbc60fd-1785-4f94-9436-a520ec06cdaf,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=fcbc60fd-1785-4f94-9436-a520ec06cdaf,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=fcbc60fd-1785-4f94-9436-a520ec06cdaf,segment=NetworkSegment(294bd754-f77e-4dd5-a8a8-fa66c41ba024),segment_id=294bd754-f77e-4dd5-a8a8-fa66c41ba024)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:05:54.067307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-9a979097-d688-42ea-aa27-3269d5c83da6 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (fcbc60fd-1785-4f94-9436-a520ec06cdaf), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:54.145685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-3385d8c2-b8f7-405d-a818-af95a807eef6 service neutron] Resource Port e0a049e7-02dc-4e07-af75-3de7fbe36b23 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=e0a049e7-02dc-4e07-af75-3de7fbe36b23,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=e0a049e7-02dc-4e07-af75-3de7fbe36b23,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=e0a049e7-02dc-4e07-af75-3de7fbe36b23,segment=NetworkSegment(929a573e-75ef-46ab-9889-4a31869bd81c),segment_id=929a573e-75ef-46ab-9889-4a31869bd81c)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:05:54.146309 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-3385d8c2-b8f7-405d-a818-af95a807eef6 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (e0a049e7-02dc-4e07-af75-3de7fbe36b23), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:54.212460 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:272 started Sep 04 01:05:54.223786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5527,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=607000000,duration_sec=563,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:05:54.223786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:05:54.223786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:272 - starting polling. Elapsed:0.004 Sep 04 01:05:54.223786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:54.224266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:272 - port information retrieved. Elapsed:0.011 Sep 04 01:05:54.224266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:272 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 04 01:05:54.552723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Resource Port e9c83c9b-f295-4069-84cf-ff7c294ae4cd updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:05:54.553435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (e9c83c9b-f295-4069-84cf-ff7c294ae4cd), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:54.655353 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Resource Port addc777a-4bdc-4153-92fa-8184c15d2cd1 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:05:54.655909 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (addc777a-4bdc-4153-92fa-8184c15d2cd1), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:56.213546 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:273 started Sep 04 01:05:56.215961 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5529,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=607000000,duration_sec=565,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:05:56.216528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:05:56.216858 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:273 - starting polling. Elapsed:0.004 Sep 04 01:05:56.219485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:05:56.222933 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:273 - port information retrieved. Elapsed:0.010 Sep 04 01:05:56.223260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:273 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Sep 04 01:05:58.214030 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:274 started Sep 04 01:05:58.216437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade552b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=608000000,duration_sec=567,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:05:58.217024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:05:58.217407 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:274 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:05:58.872652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Resource Port e9c83c9b-f295-4069-84cf-ff7c294ae4cd updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:05:58.873034 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (e9c83c9b-f295-4069-84cf-ff7c294ae4cd), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:00.215944 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:275 started Sep 04 01:06:00.220134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade552d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=612000000,duration_sec=569,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:06:00.221141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:06:00.222379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:275 - starting polling. Elapsed:0.007 Sep 04 01:06:00.238102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:00.254631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:275 - port information retrieved. Elapsed:0.039 Sep 04 01:06:00.258109 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:275 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.040 Sep 04 01:06:01.858575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b43cbcfa-eac0-41f0-b818-952afff2052d admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:06:01Z,description='Default security group',id=76e9eee2-3a5d-4156-877a-6f0218b355fa,is_default=True,name='default',project_id='8d0a8304bc0845249f776ea53f3567cf',revision_number=1,rules=[SecurityGroupRule(4227f526-e474-4dc3-8dbc-ac1cb60b35eb),SecurityGroupRule(73f184db-213e-4205-b46b-fb050667a7a7),SecurityGroupRule(a5f325f8-50d9-4127-9b18-5d68832f15c7),SecurityGroupRule(fcbc8d61-d6d7-4e2b-9ca1-6a13bb1c16a1)],shared=False,stateful=True,updated_at=2022-09-04T01:06:01Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:01.866844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b43cbcfa-eac0-41f0-b818-952afff2052d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (76e9eee2-3a5d-4156-877a-6f0218b355fa), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:01.867611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b43cbcfa-eac0-41f0-b818-952afff2052d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:01Z,description=,direction='ingress',ethertype='IPv4',id=4227f526-e474-4dc3-8dbc-ac1cb60b35eb,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8d0a8304bc0845249f776ea53f3567cf',protocol=,remote_address_group_id=,remote_group_id=76e9eee2-3a5d-4156-877a-6f0218b355fa,remote_ip_prefix=,revision_number=0,security_group_id=76e9eee2-3a5d-4156-877a-6f0218b355fa,updated_at=2022-09-04T01:06:01Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:01.867984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b43cbcfa-eac0-41f0-b818-952afff2052d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (4227f526-e474-4dc3-8dbc-ac1cb60b35eb), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:01.868329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-b43cbcfa-eac0-41f0-b818-952afff2052d admin admin] Security group rule updated ['76e9eee2-3a5d-4156-877a-6f0218b355fa'] Sep 04 01:06:01.869062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b43cbcfa-eac0-41f0-b818-952afff2052d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:01Z,description=,direction='egress',ethertype='IPv4',id=73f184db-213e-4205-b46b-fb050667a7a7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8d0a8304bc0845249f776ea53f3567cf',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=76e9eee2-3a5d-4156-877a-6f0218b355fa,updated_at=2022-09-04T01:06:01Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:01.869441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b43cbcfa-eac0-41f0-b818-952afff2052d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (73f184db-213e-4205-b46b-fb050667a7a7), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:01.869827 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-b43cbcfa-eac0-41f0-b818-952afff2052d admin admin] Security group rule updated ['76e9eee2-3a5d-4156-877a-6f0218b355fa'] Sep 04 01:06:01.870534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b43cbcfa-eac0-41f0-b818-952afff2052d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:01Z,description=,direction='ingress',ethertype='IPv6',id=a5f325f8-50d9-4127-9b18-5d68832f15c7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8d0a8304bc0845249f776ea53f3567cf',protocol=,remote_address_group_id=,remote_group_id=76e9eee2-3a5d-4156-877a-6f0218b355fa,remote_ip_prefix=,revision_number=0,security_group_id=76e9eee2-3a5d-4156-877a-6f0218b355fa,updated_at=2022-09-04T01:06:01Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:01.870892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b43cbcfa-eac0-41f0-b818-952afff2052d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (a5f325f8-50d9-4127-9b18-5d68832f15c7), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:01.871218 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-b43cbcfa-eac0-41f0-b818-952afff2052d admin admin] Security group rule updated ['76e9eee2-3a5d-4156-877a-6f0218b355fa'] Sep 04 01:06:01.871948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b43cbcfa-eac0-41f0-b818-952afff2052d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:01Z,description=,direction='egress',ethertype='IPv6',id=fcbc8d61-d6d7-4e2b-9ca1-6a13bb1c16a1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8d0a8304bc0845249f776ea53f3567cf',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=76e9eee2-3a5d-4156-877a-6f0218b355fa,updated_at=2022-09-04T01:06:01Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:01.872299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b43cbcfa-eac0-41f0-b818-952afff2052d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (fcbc8d61-d6d7-4e2b-9ca1-6a13bb1c16a1), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:01.872626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-b43cbcfa-eac0-41f0-b818-952afff2052d admin admin] Security group rule updated ['76e9eee2-3a5d-4156-877a-6f0218b355fa'] Sep 04 01:06:02.188233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-8d76260d-7b75-4a40-9995-a4b639437746 admin admin] Resource SecurityGroup deleted: 76e9eee2-3a5d-4156-877a-6f0218b355fa {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:02.188691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-8d76260d-7b75-4a40-9995-a4b639437746 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (76e9eee2-3a5d-4156-877a-6f0218b355fa), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:02.189515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d76260d-7b75-4a40-9995-a4b639437746 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('76e9eee2-3a5d-4156-877a-6f0218b355fa',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:06:02.204226 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-8d76260d-7b75-4a40-9995-a4b639437746 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('76e9eee2-3a5d-4156-877a-6f0218b355fa',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:06:02.204918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-8d76260d-7b75-4a40-9995-a4b639437746 admin admin] Resource SecurityGroupRule deleted: 4227f526-e474-4dc3-8dbc-ac1cb60b35eb {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:02.205513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-8d76260d-7b75-4a40-9995-a4b639437746 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (4227f526-e474-4dc3-8dbc-ac1cb60b35eb), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:02.207677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-8d76260d-7b75-4a40-9995-a4b639437746 admin admin] Security group rule updated ['76e9eee2-3a5d-4156-877a-6f0218b355fa'] Sep 04 01:06:02.208435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-8d76260d-7b75-4a40-9995-a4b639437746 admin admin] Resource SecurityGroupRule deleted: 73f184db-213e-4205-b46b-fb050667a7a7 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:02.208850 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-8d76260d-7b75-4a40-9995-a4b639437746 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (73f184db-213e-4205-b46b-fb050667a7a7), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:02.209200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-8d76260d-7b75-4a40-9995-a4b639437746 admin admin] Security group rule updated ['76e9eee2-3a5d-4156-877a-6f0218b355fa'] Sep 04 01:06:02.209626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-8d76260d-7b75-4a40-9995-a4b639437746 admin admin] Resource SecurityGroupRule deleted: a5f325f8-50d9-4127-9b18-5d68832f15c7 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:02.209970 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-8d76260d-7b75-4a40-9995-a4b639437746 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (a5f325f8-50d9-4127-9b18-5d68832f15c7), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:02.210287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-8d76260d-7b75-4a40-9995-a4b639437746 admin admin] Security group rule updated ['76e9eee2-3a5d-4156-877a-6f0218b355fa'] Sep 04 01:06:02.210717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-8d76260d-7b75-4a40-9995-a4b639437746 admin admin] Resource SecurityGroupRule deleted: fcbc8d61-d6d7-4e2b-9ca1-6a13bb1c16a1 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:02.211121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-8d76260d-7b75-4a40-9995-a4b639437746 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (fcbc8d61-d6d7-4e2b-9ca1-6a13bb1c16a1), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:02.211467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-8d76260d-7b75-4a40-9995-a4b639437746 admin admin] Security group rule updated ['76e9eee2-3a5d-4156-877a-6f0218b355fa'] Sep 04 01:06:02.216614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:276 started Sep 04 01:06:02.219326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade552f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=611000000,duration_sec=571,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:06:02.220409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:06:02.220760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:276 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:06:03.089541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-ea64834d-feba-445d-8604-923f35dd074a admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:06:02Z,description='Default security group',id=7b018c77-cec0-4196-a9b2-a7b23b957cfd,is_default=True,name='default',project_id='174be28425554302a7e0829820fda15b',revision_number=1,rules=[SecurityGroupRule(96508477-fad4-495a-81b9-c75857535910),SecurityGroupRule(9fdc9bb9-def5-4fbf-acb0-3fad04825874),SecurityGroupRule(ac186b30-ba25-4a35-89dd-72ee342f3068),SecurityGroupRule(e6f86625-7ed2-4c90-ad7f-53316bb26538)],shared=False,stateful=True,updated_at=2022-09-04T01:06:02Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:03.090206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-ea64834d-feba-445d-8604-923f35dd074a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (7b018c77-cec0-4196-a9b2-a7b23b957cfd), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:03.090584 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-ea64834d-feba-445d-8604-923f35dd074a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:02Z,description=,direction='ingress',ethertype='IPv6',id=96508477-fad4-495a-81b9-c75857535910,normalized_cidr=None,port_range_max=,port_range_min=,project_id='174be28425554302a7e0829820fda15b',protocol=,remote_address_group_id=,remote_group_id=7b018c77-cec0-4196-a9b2-a7b23b957cfd,remote_ip_prefix=,revision_number=0,security_group_id=7b018c77-cec0-4196-a9b2-a7b23b957cfd,updated_at=2022-09-04T01:06:02Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:03.090951 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-ea64834d-feba-445d-8604-923f35dd074a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (96508477-fad4-495a-81b9-c75857535910), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:03.092476 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-ea64834d-feba-445d-8604-923f35dd074a admin admin] Security group rule updated ['7b018c77-cec0-4196-a9b2-a7b23b957cfd'] Sep 04 01:06:03.092476 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-ea64834d-feba-445d-8604-923f35dd074a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:02Z,description=,direction='egress',ethertype='IPv4',id=9fdc9bb9-def5-4fbf-acb0-3fad04825874,normalized_cidr=None,port_range_max=,port_range_min=,project_id='174be28425554302a7e0829820fda15b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=7b018c77-cec0-4196-a9b2-a7b23b957cfd,updated_at=2022-09-04T01:06:02Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:03.092476 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-ea64834d-feba-445d-8604-923f35dd074a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (9fdc9bb9-def5-4fbf-acb0-3fad04825874), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:03.092764 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-ea64834d-feba-445d-8604-923f35dd074a admin admin] Security group rule updated ['7b018c77-cec0-4196-a9b2-a7b23b957cfd'] Sep 04 01:06:03.093440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-ea64834d-feba-445d-8604-923f35dd074a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:02Z,description=,direction='egress',ethertype='IPv6',id=ac186b30-ba25-4a35-89dd-72ee342f3068,normalized_cidr=None,port_range_max=,port_range_min=,project_id='174be28425554302a7e0829820fda15b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=7b018c77-cec0-4196-a9b2-a7b23b957cfd,updated_at=2022-09-04T01:06:02Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:03.093796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-ea64834d-feba-445d-8604-923f35dd074a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (ac186b30-ba25-4a35-89dd-72ee342f3068), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:03.094125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-ea64834d-feba-445d-8604-923f35dd074a admin admin] Security group rule updated ['7b018c77-cec0-4196-a9b2-a7b23b957cfd'] Sep 04 01:06:03.094832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-ea64834d-feba-445d-8604-923f35dd074a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:02Z,description=,direction='ingress',ethertype='IPv4',id=e6f86625-7ed2-4c90-ad7f-53316bb26538,normalized_cidr=None,port_range_max=,port_range_min=,project_id='174be28425554302a7e0829820fda15b',protocol=,remote_address_group_id=,remote_group_id=7b018c77-cec0-4196-a9b2-a7b23b957cfd,remote_ip_prefix=,revision_number=0,security_group_id=7b018c77-cec0-4196-a9b2-a7b23b957cfd,updated_at=2022-09-04T01:06:02Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:03.095218 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-ea64834d-feba-445d-8604-923f35dd074a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (e6f86625-7ed2-4c90-ad7f-53316bb26538), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:03.095546 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-ea64834d-feba-445d-8604-923f35dd074a admin admin] Security group rule updated ['7b018c77-cec0-4196-a9b2-a7b23b957cfd'] Sep 04 01:06:03.323911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-03c2e7a1-b677-4419-92d3-d47b926ee718 admin admin] Resource SecurityGroup deleted: 7b018c77-cec0-4196-a9b2-a7b23b957cfd {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:03.324450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-03c2e7a1-b677-4419-92d3-d47b926ee718 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (7b018c77-cec0-4196-a9b2-a7b23b957cfd), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:03.324999 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03c2e7a1-b677-4419-92d3-d47b926ee718 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('7b018c77-cec0-4196-a9b2-a7b23b957cfd',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:06:03.339873 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-03c2e7a1-b677-4419-92d3-d47b926ee718 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('7b018c77-cec0-4196-a9b2-a7b23b957cfd',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:06:03.340553 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-03c2e7a1-b677-4419-92d3-d47b926ee718 admin admin] Resource SecurityGroupRule deleted: 96508477-fad4-495a-81b9-c75857535910 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:03.341117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-03c2e7a1-b677-4419-92d3-d47b926ee718 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (96508477-fad4-495a-81b9-c75857535910), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:03.341499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-03c2e7a1-b677-4419-92d3-d47b926ee718 admin admin] Security group rule updated ['7b018c77-cec0-4196-a9b2-a7b23b957cfd'] Sep 04 01:06:03.342002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-03c2e7a1-b677-4419-92d3-d47b926ee718 admin admin] Resource SecurityGroupRule deleted: 9fdc9bb9-def5-4fbf-acb0-3fad04825874 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:03.342412 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-03c2e7a1-b677-4419-92d3-d47b926ee718 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (9fdc9bb9-def5-4fbf-acb0-3fad04825874), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:03.342795 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-03c2e7a1-b677-4419-92d3-d47b926ee718 admin admin] Security group rule updated ['7b018c77-cec0-4196-a9b2-a7b23b957cfd'] Sep 04 01:06:03.343273 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-03c2e7a1-b677-4419-92d3-d47b926ee718 admin admin] Resource SecurityGroupRule deleted: ac186b30-ba25-4a35-89dd-72ee342f3068 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:03.343845 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-03c2e7a1-b677-4419-92d3-d47b926ee718 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (ac186b30-ba25-4a35-89dd-72ee342f3068), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:03.344223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-03c2e7a1-b677-4419-92d3-d47b926ee718 admin admin] Security group rule updated ['7b018c77-cec0-4196-a9b2-a7b23b957cfd'] Sep 04 01:06:03.345258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-03c2e7a1-b677-4419-92d3-d47b926ee718 admin admin] Resource SecurityGroupRule deleted: e6f86625-7ed2-4c90-ad7f-53316bb26538 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:03.345780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-03c2e7a1-b677-4419-92d3-d47b926ee718 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (e6f86625-7ed2-4c90-ad7f-53316bb26538), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:03.346273 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-03c2e7a1-b677-4419-92d3-d47b926ee718 admin admin] Security group rule updated ['7b018c77-cec0-4196-a9b2-a7b23b957cfd'] Sep 04 01:06:04.157378 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Resource Port e0a049e7-02dc-4e07-af75-3de7fbe36b23 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:06:04.158033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (e0a049e7-02dc-4e07-af75-3de7fbe36b23), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:04.214137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-719d0330-f567-4a58-abb6-1ceb786a4980 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:06:04Z,description='Default security group',id=6a33d1cd-af5f-437f-bfdc-e37f39c5bb9c,is_default=True,name='default',project_id='760186835723424d857dde933c062bea',revision_number=1,rules=[SecurityGroupRule(c3da86fa-f5a3-4a16-8df2-a8e856e99680),SecurityGroupRule(d7c64cb9-7235-4bb1-a780-58f1dc8067de),SecurityGroupRule(f1df14ae-8cc8-4551-9912-08db125ab981),SecurityGroupRule(f1f1ac28-f310-47dd-8148-0aecd5de6584)],shared=False,stateful=True,updated_at=2022-09-04T01:06:04Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:04.214340 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-719d0330-f567-4a58-abb6-1ceb786a4980 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (6a33d1cd-af5f-437f-bfdc-e37f39c5bb9c), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:04.214973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-719d0330-f567-4a58-abb6-1ceb786a4980 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:04Z,description=,direction='ingress',ethertype='IPv6',id=c3da86fa-f5a3-4a16-8df2-a8e856e99680,normalized_cidr=None,port_range_max=,port_range_min=,project_id='760186835723424d857dde933c062bea',protocol=,remote_address_group_id=,remote_group_id=6a33d1cd-af5f-437f-bfdc-e37f39c5bb9c,remote_ip_prefix=,revision_number=0,security_group_id=6a33d1cd-af5f-437f-bfdc-e37f39c5bb9c,updated_at=2022-09-04T01:06:04Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:04.215334 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-719d0330-f567-4a58-abb6-1ceb786a4980 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (c3da86fa-f5a3-4a16-8df2-a8e856e99680), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:04.215670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-719d0330-f567-4a58-abb6-1ceb786a4980 admin admin] Security group rule updated ['6a33d1cd-af5f-437f-bfdc-e37f39c5bb9c'] Sep 04 01:06:04.216385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-719d0330-f567-4a58-abb6-1ceb786a4980 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:04Z,description=,direction='egress',ethertype='IPv6',id=d7c64cb9-7235-4bb1-a780-58f1dc8067de,normalized_cidr=None,port_range_max=,port_range_min=,project_id='760186835723424d857dde933c062bea',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=6a33d1cd-af5f-437f-bfdc-e37f39c5bb9c,updated_at=2022-09-04T01:06:04Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:04.216739 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-719d0330-f567-4a58-abb6-1ceb786a4980 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (d7c64cb9-7235-4bb1-a780-58f1dc8067de), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:04.217092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-719d0330-f567-4a58-abb6-1ceb786a4980 admin admin] Security group rule updated ['6a33d1cd-af5f-437f-bfdc-e37f39c5bb9c'] Sep 04 01:06:04.217801 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-719d0330-f567-4a58-abb6-1ceb786a4980 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:04Z,description=,direction='ingress',ethertype='IPv4',id=f1df14ae-8cc8-4551-9912-08db125ab981,normalized_cidr=None,port_range_max=,port_range_min=,project_id='760186835723424d857dde933c062bea',protocol=,remote_address_group_id=,remote_group_id=6a33d1cd-af5f-437f-bfdc-e37f39c5bb9c,remote_ip_prefix=,revision_number=0,security_group_id=6a33d1cd-af5f-437f-bfdc-e37f39c5bb9c,updated_at=2022-09-04T01:06:04Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:04.218152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-719d0330-f567-4a58-abb6-1ceb786a4980 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (f1df14ae-8cc8-4551-9912-08db125ab981), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:04.218552 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-719d0330-f567-4a58-abb6-1ceb786a4980 admin admin] Security group rule updated ['6a33d1cd-af5f-437f-bfdc-e37f39c5bb9c'] Sep 04 01:06:04.219174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-719d0330-f567-4a58-abb6-1ceb786a4980 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:04Z,description=,direction='egress',ethertype='IPv4',id=f1f1ac28-f310-47dd-8148-0aecd5de6584,normalized_cidr=None,port_range_max=,port_range_min=,project_id='760186835723424d857dde933c062bea',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=6a33d1cd-af5f-437f-bfdc-e37f39c5bb9c,updated_at=2022-09-04T01:06:04Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:04.219525 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-719d0330-f567-4a58-abb6-1ceb786a4980 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (f1f1ac28-f310-47dd-8148-0aecd5de6584), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:04.219850 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-719d0330-f567-4a58-abb6-1ceb786a4980 admin admin] Security group rule updated ['6a33d1cd-af5f-437f-bfdc-e37f39c5bb9c'] Sep 04 01:06:04.220797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:277 started Sep 04 01:06:04.223157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5531,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=615000000,duration_sec=573,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:06:04.224427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:06:04.224757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:277 - starting polling. Elapsed:0.004 Sep 04 01:06:04.227322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:04.230753 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:277 - port information retrieved. Elapsed:0.010 Sep 04 01:06:04.231103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:277 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Sep 04 01:06:04.462786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-af0be748-d781-4a7c-8d08-978013a099b5 admin admin] Resource SecurityGroup deleted: 6a33d1cd-af5f-437f-bfdc-e37f39c5bb9c {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:04.466915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-af0be748-d781-4a7c-8d08-978013a099b5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (6a33d1cd-af5f-437f-bfdc-e37f39c5bb9c), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:04.466915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af0be748-d781-4a7c-8d08-978013a099b5 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('6a33d1cd-af5f-437f-bfdc-e37f39c5bb9c',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:06:04.480849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-af0be748-d781-4a7c-8d08-978013a099b5 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('6a33d1cd-af5f-437f-bfdc-e37f39c5bb9c',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:06:04.481698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-af0be748-d781-4a7c-8d08-978013a099b5 admin admin] Resource SecurityGroupRule deleted: c3da86fa-f5a3-4a16-8df2-a8e856e99680 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:04.484641 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-af0be748-d781-4a7c-8d08-978013a099b5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (c3da86fa-f5a3-4a16-8df2-a8e856e99680), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:04.486448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-af0be748-d781-4a7c-8d08-978013a099b5 admin admin] Security group rule updated ['6a33d1cd-af5f-437f-bfdc-e37f39c5bb9c'] Sep 04 01:06:04.486979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-af0be748-d781-4a7c-8d08-978013a099b5 admin admin] Resource SecurityGroupRule deleted: d7c64cb9-7235-4bb1-a780-58f1dc8067de {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:04.489712 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-af0be748-d781-4a7c-8d08-978013a099b5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (d7c64cb9-7235-4bb1-a780-58f1dc8067de), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:04.490066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-af0be748-d781-4a7c-8d08-978013a099b5 admin admin] Security group rule updated ['6a33d1cd-af5f-437f-bfdc-e37f39c5bb9c'] Sep 04 01:06:04.490523 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-af0be748-d781-4a7c-8d08-978013a099b5 admin admin] Resource SecurityGroupRule deleted: f1df14ae-8cc8-4551-9912-08db125ab981 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:04.490846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-af0be748-d781-4a7c-8d08-978013a099b5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (f1df14ae-8cc8-4551-9912-08db125ab981), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:04.491174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-af0be748-d781-4a7c-8d08-978013a099b5 admin admin] Security group rule updated ['6a33d1cd-af5f-437f-bfdc-e37f39c5bb9c'] Sep 04 01:06:04.492753 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-af0be748-d781-4a7c-8d08-978013a099b5 admin admin] Resource SecurityGroupRule deleted: f1f1ac28-f310-47dd-8148-0aecd5de6584 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:04.494057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-af0be748-d781-4a7c-8d08-978013a099b5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (f1f1ac28-f310-47dd-8148-0aecd5de6584), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:04.494593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-af0be748-d781-4a7c-8d08-978013a099b5 admin admin] Security group rule updated ['6a33d1cd-af5f-437f-bfdc-e37f39c5bb9c'] Sep 04 01:06:06.223261 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:278 started Sep 04 01:06:06.225544 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5533,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=616000000,duration_sec=575,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:06:06.226156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:06:06.226505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:278 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:06:06.807414 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-44992ba9-3f46-4592-96e6-b5b09f4bb8b2 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:06:06Z,description='Default security group',id=bc78cc56-5167-4833-81d9-063f8e2ef18c,is_default=True,name='default',project_id='3d5b10aa7be846c89453abdba743b025',revision_number=1,rules=[SecurityGroupRule(258a9501-ce68-473a-bef8-a158cd4b8fd1),SecurityGroupRule(36d3c7d0-c93a-4f30-bb7d-4964d63d7068),SecurityGroupRule(a009080b-2de0-4251-b8cc-6cc5289cd817),SecurityGroupRule(ca1d7e6d-451e-497e-9d4d-3f57dc17f003)],shared=False,stateful=True,updated_at=2022-09-04T01:06:06Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:06.808218 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-44992ba9-3f46-4592-96e6-b5b09f4bb8b2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (bc78cc56-5167-4833-81d9-063f8e2ef18c), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:06.808900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-44992ba9-3f46-4592-96e6-b5b09f4bb8b2 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:06Z,description=,direction='ingress',ethertype='IPv4',id=258a9501-ce68-473a-bef8-a158cd4b8fd1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3d5b10aa7be846c89453abdba743b025',protocol=,remote_address_group_id=,remote_group_id=bc78cc56-5167-4833-81d9-063f8e2ef18c,remote_ip_prefix=,revision_number=0,security_group_id=bc78cc56-5167-4833-81d9-063f8e2ef18c,updated_at=2022-09-04T01:06:06Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:06.809291 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-44992ba9-3f46-4592-96e6-b5b09f4bb8b2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (258a9501-ce68-473a-bef8-a158cd4b8fd1), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:06.809823 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-44992ba9-3f46-4592-96e6-b5b09f4bb8b2 admin admin] Security group rule updated ['bc78cc56-5167-4833-81d9-063f8e2ef18c'] Sep 04 01:06:06.810601 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-44992ba9-3f46-4592-96e6-b5b09f4bb8b2 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:06Z,description=,direction='ingress',ethertype='IPv6',id=36d3c7d0-c93a-4f30-bb7d-4964d63d7068,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3d5b10aa7be846c89453abdba743b025',protocol=,remote_address_group_id=,remote_group_id=bc78cc56-5167-4833-81d9-063f8e2ef18c,remote_ip_prefix=,revision_number=0,security_group_id=bc78cc56-5167-4833-81d9-063f8e2ef18c,updated_at=2022-09-04T01:06:06Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:06.810964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-44992ba9-3f46-4592-96e6-b5b09f4bb8b2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (36d3c7d0-c93a-4f30-bb7d-4964d63d7068), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:06.811611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-44992ba9-3f46-4592-96e6-b5b09f4bb8b2 admin admin] Security group rule updated ['bc78cc56-5167-4833-81d9-063f8e2ef18c'] Sep 04 01:06:06.822341 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-44992ba9-3f46-4592-96e6-b5b09f4bb8b2 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:06Z,description=,direction='egress',ethertype='IPv4',id=a009080b-2de0-4251-b8cc-6cc5289cd817,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3d5b10aa7be846c89453abdba743b025',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=bc78cc56-5167-4833-81d9-063f8e2ef18c,updated_at=2022-09-04T01:06:06Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:06.822729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-44992ba9-3f46-4592-96e6-b5b09f4bb8b2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (a009080b-2de0-4251-b8cc-6cc5289cd817), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:06.825839 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-44992ba9-3f46-4592-96e6-b5b09f4bb8b2 admin admin] Security group rule updated ['bc78cc56-5167-4833-81d9-063f8e2ef18c'] Sep 04 01:06:06.825839 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-44992ba9-3f46-4592-96e6-b5b09f4bb8b2 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:06Z,description=,direction='egress',ethertype='IPv6',id=ca1d7e6d-451e-497e-9d4d-3f57dc17f003,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3d5b10aa7be846c89453abdba743b025',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=bc78cc56-5167-4833-81d9-063f8e2ef18c,updated_at=2022-09-04T01:06:06Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:06.825839 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-44992ba9-3f46-4592-96e6-b5b09f4bb8b2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (ca1d7e6d-451e-497e-9d4d-3f57dc17f003), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:06.825839 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-44992ba9-3f46-4592-96e6-b5b09f4bb8b2 admin admin] Security group rule updated ['bc78cc56-5167-4833-81d9-063f8e2ef18c'] Sep 04 01:06:07.085623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-19eaeb87-c086-4ec0-baba-54ba7e9386a1 admin admin] Resource SecurityGroup deleted: bc78cc56-5167-4833-81d9-063f8e2ef18c {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:07.086001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-19eaeb87-c086-4ec0-baba-54ba7e9386a1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (bc78cc56-5167-4833-81d9-063f8e2ef18c), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:07.086458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19eaeb87-c086-4ec0-baba-54ba7e9386a1 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('bc78cc56-5167-4833-81d9-063f8e2ef18c',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:06:07.108655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-19eaeb87-c086-4ec0-baba-54ba7e9386a1 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('bc78cc56-5167-4833-81d9-063f8e2ef18c',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:06:07.108655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-19eaeb87-c086-4ec0-baba-54ba7e9386a1 admin admin] Resource SecurityGroupRule deleted: 258a9501-ce68-473a-bef8-a158cd4b8fd1 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:07.108655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-19eaeb87-c086-4ec0-baba-54ba7e9386a1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (258a9501-ce68-473a-bef8-a158cd4b8fd1), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:07.108655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-19eaeb87-c086-4ec0-baba-54ba7e9386a1 admin admin] Security group rule updated ['bc78cc56-5167-4833-81d9-063f8e2ef18c'] Sep 04 01:06:07.108655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-19eaeb87-c086-4ec0-baba-54ba7e9386a1 admin admin] Resource SecurityGroupRule deleted: 36d3c7d0-c93a-4f30-bb7d-4964d63d7068 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:07.109064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-19eaeb87-c086-4ec0-baba-54ba7e9386a1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (36d3c7d0-c93a-4f30-bb7d-4964d63d7068), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:07.112559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-19eaeb87-c086-4ec0-baba-54ba7e9386a1 admin admin] Security group rule updated ['bc78cc56-5167-4833-81d9-063f8e2ef18c'] Sep 04 01:06:07.113229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-19eaeb87-c086-4ec0-baba-54ba7e9386a1 admin admin] Resource SecurityGroupRule deleted: a009080b-2de0-4251-b8cc-6cc5289cd817 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:07.113757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-19eaeb87-c086-4ec0-baba-54ba7e9386a1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (a009080b-2de0-4251-b8cc-6cc5289cd817), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:07.114103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-19eaeb87-c086-4ec0-baba-54ba7e9386a1 admin admin] Security group rule updated ['bc78cc56-5167-4833-81d9-063f8e2ef18c'] Sep 04 01:06:07.114628 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-19eaeb87-c086-4ec0-baba-54ba7e9386a1 admin admin] Resource SecurityGroupRule deleted: ca1d7e6d-451e-497e-9d4d-3f57dc17f003 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:07.115140 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-19eaeb87-c086-4ec0-baba-54ba7e9386a1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (ca1d7e6d-451e-497e-9d4d-3f57dc17f003), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:07.115521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-19eaeb87-c086-4ec0-baba-54ba7e9386a1 admin admin] Security group rule updated ['bc78cc56-5167-4833-81d9-063f8e2ef18c'] Sep 04 01:06:07.282610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Resource Port e0a049e7-02dc-4e07-af75-3de7fbe36b23 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:06:07.283239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (e0a049e7-02dc-4e07-af75-3de7fbe36b23), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:08.223008 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:279 started Sep 04 01:06:08.225561 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5535,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=617000000,duration_sec=577,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:06:08.226342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:06:08.226817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:279 - starting polling. Elapsed:0.004 Sep 04 01:06:08.230448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:08.234500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:279 - port information retrieved. Elapsed:0.012 Sep 04 01:06:08.235042 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:279 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Sep 04 01:06:08.575537 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-033080be-6d3a-4491-bdd7-2f31b396fe1e admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:06:08Z,description='Default security group',id=341774ea-90df-44bd-b299-1971d354660b,is_default=True,name='default',project_id='465c8420550d4f75a178d3ccfbf4d501',revision_number=1,rules=[SecurityGroupRule(29cca525-c3dc-4ce4-922a-ff59c4185d24),SecurityGroupRule(60efad75-fa42-44aa-bb7b-8914a12b9138),SecurityGroupRule(9ae9761e-35e9-4b16-9d41-48212eae9a87),SecurityGroupRule(ead98049-7e1d-4af6-8457-f277e3f377e7)],shared=False,stateful=True,updated_at=2022-09-04T01:06:08Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:08.576203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-033080be-6d3a-4491-bdd7-2f31b396fe1e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (341774ea-90df-44bd-b299-1971d354660b), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:08.576694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-033080be-6d3a-4491-bdd7-2f31b396fe1e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:08Z,description=,direction='egress',ethertype='IPv6',id=29cca525-c3dc-4ce4-922a-ff59c4185d24,normalized_cidr=None,port_range_max=,port_range_min=,project_id='465c8420550d4f75a178d3ccfbf4d501',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=341774ea-90df-44bd-b299-1971d354660b,updated_at=2022-09-04T01:06:08Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:08.577166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-033080be-6d3a-4491-bdd7-2f31b396fe1e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (29cca525-c3dc-4ce4-922a-ff59c4185d24), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:08.577566 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-033080be-6d3a-4491-bdd7-2f31b396fe1e admin admin] Security group rule updated ['341774ea-90df-44bd-b299-1971d354660b'] Sep 04 01:06:08.578399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-033080be-6d3a-4491-bdd7-2f31b396fe1e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:08Z,description=,direction='ingress',ethertype='IPv4',id=60efad75-fa42-44aa-bb7b-8914a12b9138,normalized_cidr=None,port_range_max=,port_range_min=,project_id='465c8420550d4f75a178d3ccfbf4d501',protocol=,remote_address_group_id=,remote_group_id=341774ea-90df-44bd-b299-1971d354660b,remote_ip_prefix=,revision_number=0,security_group_id=341774ea-90df-44bd-b299-1971d354660b,updated_at=2022-09-04T01:06:08Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:08.579008 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-033080be-6d3a-4491-bdd7-2f31b396fe1e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (60efad75-fa42-44aa-bb7b-8914a12b9138), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:08.579411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-033080be-6d3a-4491-bdd7-2f31b396fe1e admin admin] Security group rule updated ['341774ea-90df-44bd-b299-1971d354660b'] Sep 04 01:06:08.580401 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-033080be-6d3a-4491-bdd7-2f31b396fe1e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:08Z,description=,direction='ingress',ethertype='IPv6',id=9ae9761e-35e9-4b16-9d41-48212eae9a87,normalized_cidr=None,port_range_max=,port_range_min=,project_id='465c8420550d4f75a178d3ccfbf4d501',protocol=,remote_address_group_id=,remote_group_id=341774ea-90df-44bd-b299-1971d354660b,remote_ip_prefix=,revision_number=0,security_group_id=341774ea-90df-44bd-b299-1971d354660b,updated_at=2022-09-04T01:06:08Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:08.586937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-033080be-6d3a-4491-bdd7-2f31b396fe1e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (9ae9761e-35e9-4b16-9d41-48212eae9a87), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:08.593654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-033080be-6d3a-4491-bdd7-2f31b396fe1e admin admin] Security group rule updated ['341774ea-90df-44bd-b299-1971d354660b'] Sep 04 01:06:08.599972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-033080be-6d3a-4491-bdd7-2f31b396fe1e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:08Z,description=,direction='egress',ethertype='IPv4',id=ead98049-7e1d-4af6-8457-f277e3f377e7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='465c8420550d4f75a178d3ccfbf4d501',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=341774ea-90df-44bd-b299-1971d354660b,updated_at=2022-09-04T01:06:08Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:08.601808 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-033080be-6d3a-4491-bdd7-2f31b396fe1e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (ead98049-7e1d-4af6-8457-f277e3f377e7), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:08.602692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-033080be-6d3a-4491-bdd7-2f31b396fe1e admin admin] Security group rule updated ['341774ea-90df-44bd-b299-1971d354660b'] Sep 04 01:06:09.083419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-be69d677-d645-41b4-8c6c-c741eef7a4c8 admin admin] Resource SecurityGroup deleted: 341774ea-90df-44bd-b299-1971d354660b {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:09.089349 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-be69d677-d645-41b4-8c6c-c741eef7a4c8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (341774ea-90df-44bd-b299-1971d354660b), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:09.089349 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be69d677-d645-41b4-8c6c-c741eef7a4c8 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('341774ea-90df-44bd-b299-1971d354660b',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:06:09.104733 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-be69d677-d645-41b4-8c6c-c741eef7a4c8 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('341774ea-90df-44bd-b299-1971d354660b',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:06:09.107440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-be69d677-d645-41b4-8c6c-c741eef7a4c8 admin admin] Resource SecurityGroupRule deleted: 29cca525-c3dc-4ce4-922a-ff59c4185d24 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:09.108112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-be69d677-d645-41b4-8c6c-c741eef7a4c8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (29cca525-c3dc-4ce4-922a-ff59c4185d24), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:09.108659 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-be69d677-d645-41b4-8c6c-c741eef7a4c8 admin admin] Security group rule updated ['341774ea-90df-44bd-b299-1971d354660b'] Sep 04 01:06:09.109269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-be69d677-d645-41b4-8c6c-c741eef7a4c8 admin admin] Resource SecurityGroupRule deleted: 60efad75-fa42-44aa-bb7b-8914a12b9138 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:09.109861 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-be69d677-d645-41b4-8c6c-c741eef7a4c8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (60efad75-fa42-44aa-bb7b-8914a12b9138), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:09.110331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-be69d677-d645-41b4-8c6c-c741eef7a4c8 admin admin] Security group rule updated ['341774ea-90df-44bd-b299-1971d354660b'] Sep 04 01:06:09.111208 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-be69d677-d645-41b4-8c6c-c741eef7a4c8 admin admin] Resource SecurityGroupRule deleted: 9ae9761e-35e9-4b16-9d41-48212eae9a87 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:09.111724 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-be69d677-d645-41b4-8c6c-c741eef7a4c8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (9ae9761e-35e9-4b16-9d41-48212eae9a87), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:09.112123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-be69d677-d645-41b4-8c6c-c741eef7a4c8 admin admin] Security group rule updated ['341774ea-90df-44bd-b299-1971d354660b'] Sep 04 01:06:09.113145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-be69d677-d645-41b4-8c6c-c741eef7a4c8 admin admin] Resource SecurityGroupRule deleted: ead98049-7e1d-4af6-8457-f277e3f377e7 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:09.114655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-be69d677-d645-41b4-8c6c-c741eef7a4c8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (ead98049-7e1d-4af6-8457-f277e3f377e7), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:09.115143 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-be69d677-d645-41b4-8c6c-c741eef7a4c8 admin admin] Security group rule updated ['341774ea-90df-44bd-b299-1971d354660b'] Sep 04 01:06:09.197356 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Resource Port fcbc60fd-1785-4f94-9436-a520ec06cdaf updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:06:09.197925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (fcbc60fd-1785-4f94-9436-a520ec06cdaf), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:09.336984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-e71bac03-1ae2-4b0f-b13b-68aa62ec7f2e admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:06:09Z,description='Default security group',id=25d7d8b0-f0f5-4a59-ab1b-9089cb84f468,is_default=True,name='default',project_id='ca0931d51497476f9f229632aa8e227b',revision_number=1,rules=[SecurityGroupRule(4d0cc2aa-0c4a-4c51-aa13-91ead95d4ad6),SecurityGroupRule(82bbd144-172f-4485-829b-6d3447ae8ffd),SecurityGroupRule(a2f0353e-50ad-4671-8721-34d65cb7578e),SecurityGroupRule(af157ca0-8574-4072-b575-f62d50ae1d3e)],shared=False,stateful=True,updated_at=2022-09-04T01:06:09Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:09.337470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-e71bac03-1ae2-4b0f-b13b-68aa62ec7f2e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (25d7d8b0-f0f5-4a59-ab1b-9089cb84f468), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:09.338305 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-e71bac03-1ae2-4b0f-b13b-68aa62ec7f2e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:09Z,description=,direction='egress',ethertype='IPv4',id=4d0cc2aa-0c4a-4c51-aa13-91ead95d4ad6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ca0931d51497476f9f229632aa8e227b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=25d7d8b0-f0f5-4a59-ab1b-9089cb84f468,updated_at=2022-09-04T01:06:09Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:09.338736 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-e71bac03-1ae2-4b0f-b13b-68aa62ec7f2e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (4d0cc2aa-0c4a-4c51-aa13-91ead95d4ad6), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:09.339167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-e71bac03-1ae2-4b0f-b13b-68aa62ec7f2e admin admin] Security group rule updated ['25d7d8b0-f0f5-4a59-ab1b-9089cb84f468'] Sep 04 01:06:09.340137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-e71bac03-1ae2-4b0f-b13b-68aa62ec7f2e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:09Z,description=,direction='ingress',ethertype='IPv4',id=82bbd144-172f-4485-829b-6d3447ae8ffd,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ca0931d51497476f9f229632aa8e227b',protocol=,remote_address_group_id=,remote_group_id=25d7d8b0-f0f5-4a59-ab1b-9089cb84f468,remote_ip_prefix=,revision_number=0,security_group_id=25d7d8b0-f0f5-4a59-ab1b-9089cb84f468,updated_at=2022-09-04T01:06:09Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:09.341246 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-e71bac03-1ae2-4b0f-b13b-68aa62ec7f2e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (82bbd144-172f-4485-829b-6d3447ae8ffd), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:09.341915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-e71bac03-1ae2-4b0f-b13b-68aa62ec7f2e admin admin] Security group rule updated ['25d7d8b0-f0f5-4a59-ab1b-9089cb84f468'] Sep 04 01:06:09.343738 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-e71bac03-1ae2-4b0f-b13b-68aa62ec7f2e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:09Z,description=,direction='egress',ethertype='IPv6',id=a2f0353e-50ad-4671-8721-34d65cb7578e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ca0931d51497476f9f229632aa8e227b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=25d7d8b0-f0f5-4a59-ab1b-9089cb84f468,updated_at=2022-09-04T01:06:09Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:09.344241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-e71bac03-1ae2-4b0f-b13b-68aa62ec7f2e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (a2f0353e-50ad-4671-8721-34d65cb7578e), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:09.344661 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-e71bac03-1ae2-4b0f-b13b-68aa62ec7f2e admin admin] Security group rule updated ['25d7d8b0-f0f5-4a59-ab1b-9089cb84f468'] Sep 04 01:06:09.346064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-e71bac03-1ae2-4b0f-b13b-68aa62ec7f2e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:09Z,description=,direction='ingress',ethertype='IPv6',id=af157ca0-8574-4072-b575-f62d50ae1d3e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ca0931d51497476f9f229632aa8e227b',protocol=,remote_address_group_id=,remote_group_id=25d7d8b0-f0f5-4a59-ab1b-9089cb84f468,remote_ip_prefix=,revision_number=0,security_group_id=25d7d8b0-f0f5-4a59-ab1b-9089cb84f468,updated_at=2022-09-04T01:06:09Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:09.347677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-e71bac03-1ae2-4b0f-b13b-68aa62ec7f2e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (af157ca0-8574-4072-b575-f62d50ae1d3e), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:09.348087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-e71bac03-1ae2-4b0f-b13b-68aa62ec7f2e admin admin] Security group rule updated ['25d7d8b0-f0f5-4a59-ab1b-9089cb84f468'] Sep 04 01:06:09.604537 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-58140092-2af7-430a-b817-6811a36a290e admin admin] Resource SecurityGroup deleted: 25d7d8b0-f0f5-4a59-ab1b-9089cb84f468 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:09.606030 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-58140092-2af7-430a-b817-6811a36a290e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (25d7d8b0-f0f5-4a59-ab1b-9089cb84f468), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:09.609368 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58140092-2af7-430a-b817-6811a36a290e admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('25d7d8b0-f0f5-4a59-ab1b-9089cb84f468',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:06:09.622941 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-58140092-2af7-430a-b817-6811a36a290e admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('25d7d8b0-f0f5-4a59-ab1b-9089cb84f468',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:06:09.623740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-58140092-2af7-430a-b817-6811a36a290e admin admin] Resource SecurityGroupRule deleted: 4d0cc2aa-0c4a-4c51-aa13-91ead95d4ad6 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:09.624302 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-58140092-2af7-430a-b817-6811a36a290e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (4d0cc2aa-0c4a-4c51-aa13-91ead95d4ad6), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:09.624798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-58140092-2af7-430a-b817-6811a36a290e admin admin] Security group rule updated ['25d7d8b0-f0f5-4a59-ab1b-9089cb84f468'] Sep 04 01:06:09.626542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-58140092-2af7-430a-b817-6811a36a290e admin admin] Resource SecurityGroupRule deleted: 82bbd144-172f-4485-829b-6d3447ae8ffd {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:09.626905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-58140092-2af7-430a-b817-6811a36a290e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (82bbd144-172f-4485-829b-6d3447ae8ffd), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:09.627232 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-58140092-2af7-430a-b817-6811a36a290e admin admin] Security group rule updated ['25d7d8b0-f0f5-4a59-ab1b-9089cb84f468'] Sep 04 01:06:09.627923 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-58140092-2af7-430a-b817-6811a36a290e admin admin] Resource SecurityGroupRule deleted: a2f0353e-50ad-4671-8721-34d65cb7578e {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:09.629676 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-58140092-2af7-430a-b817-6811a36a290e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (a2f0353e-50ad-4671-8721-34d65cb7578e), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:09.630009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-58140092-2af7-430a-b817-6811a36a290e admin admin] Security group rule updated ['25d7d8b0-f0f5-4a59-ab1b-9089cb84f468'] Sep 04 01:06:09.630441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-58140092-2af7-430a-b817-6811a36a290e admin admin] Resource SecurityGroupRule deleted: af157ca0-8574-4072-b575-f62d50ae1d3e {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:09.630789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-58140092-2af7-430a-b817-6811a36a290e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (af157ca0-8574-4072-b575-f62d50ae1d3e), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:09.631676 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-58140092-2af7-430a-b817-6811a36a290e admin admin] Security group rule updated ['25d7d8b0-f0f5-4a59-ab1b-9089cb84f468'] Sep 04 01:06:10.108234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-914402e2-da57-4baf-9a3a-8dfe2397e84d admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:06:09Z,description='Default security group',id=ca428776-c5dd-4dfb-a1b4-4b607344bd98,is_default=True,name='default',project_id='4612d1d746474c4ea901ab702b744f99',revision_number=1,rules=[SecurityGroupRule(3885d0bc-a537-46e2-8353-205038108da5),SecurityGroupRule(4221866a-4929-41aa-bbb9-6f54aa9d698a),SecurityGroupRule(9a31ee95-2cbf-4d5b-bdc8-cf6437db4721),SecurityGroupRule(bb5c1f4d-13dc-41b3-9598-35ab0a35a87a)],shared=False,stateful=True,updated_at=2022-09-04T01:06:09Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:10.108857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-914402e2-da57-4baf-9a3a-8dfe2397e84d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (ca428776-c5dd-4dfb-a1b4-4b607344bd98), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:10.109876 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-914402e2-da57-4baf-9a3a-8dfe2397e84d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:09Z,description=,direction='egress',ethertype='IPv4',id=3885d0bc-a537-46e2-8353-205038108da5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='4612d1d746474c4ea901ab702b744f99',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ca428776-c5dd-4dfb-a1b4-4b607344bd98,updated_at=2022-09-04T01:06:09Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:10.110376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-914402e2-da57-4baf-9a3a-8dfe2397e84d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (3885d0bc-a537-46e2-8353-205038108da5), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:10.111246 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-914402e2-da57-4baf-9a3a-8dfe2397e84d admin admin] Security group rule updated ['ca428776-c5dd-4dfb-a1b4-4b607344bd98'] Sep 04 01:06:10.112149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-914402e2-da57-4baf-9a3a-8dfe2397e84d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:09Z,description=,direction='ingress',ethertype='IPv6',id=4221866a-4929-41aa-bbb9-6f54aa9d698a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='4612d1d746474c4ea901ab702b744f99',protocol=,remote_address_group_id=,remote_group_id=ca428776-c5dd-4dfb-a1b4-4b607344bd98,remote_ip_prefix=,revision_number=0,security_group_id=ca428776-c5dd-4dfb-a1b4-4b607344bd98,updated_at=2022-09-04T01:06:09Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:10.112956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-914402e2-da57-4baf-9a3a-8dfe2397e84d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (4221866a-4929-41aa-bbb9-6f54aa9d698a), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:10.113905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-914402e2-da57-4baf-9a3a-8dfe2397e84d admin admin] Security group rule updated ['ca428776-c5dd-4dfb-a1b4-4b607344bd98'] Sep 04 01:06:10.114914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-914402e2-da57-4baf-9a3a-8dfe2397e84d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:09Z,description=,direction='ingress',ethertype='IPv4',id=9a31ee95-2cbf-4d5b-bdc8-cf6437db4721,normalized_cidr=None,port_range_max=,port_range_min=,project_id='4612d1d746474c4ea901ab702b744f99',protocol=,remote_address_group_id=,remote_group_id=ca428776-c5dd-4dfb-a1b4-4b607344bd98,remote_ip_prefix=,revision_number=0,security_group_id=ca428776-c5dd-4dfb-a1b4-4b607344bd98,updated_at=2022-09-04T01:06:09Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:10.115901 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-914402e2-da57-4baf-9a3a-8dfe2397e84d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (9a31ee95-2cbf-4d5b-bdc8-cf6437db4721), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:10.116586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-914402e2-da57-4baf-9a3a-8dfe2397e84d admin admin] Security group rule updated ['ca428776-c5dd-4dfb-a1b4-4b607344bd98'] Sep 04 01:06:10.117659 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-914402e2-da57-4baf-9a3a-8dfe2397e84d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:09Z,description=,direction='egress',ethertype='IPv6',id=bb5c1f4d-13dc-41b3-9598-35ab0a35a87a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='4612d1d746474c4ea901ab702b744f99',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ca428776-c5dd-4dfb-a1b4-4b607344bd98,updated_at=2022-09-04T01:06:09Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:10.118229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-914402e2-da57-4baf-9a3a-8dfe2397e84d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (bb5c1f4d-13dc-41b3-9598-35ab0a35a87a), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:10.118816 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-914402e2-da57-4baf-9a3a-8dfe2397e84d admin admin] Security group rule updated ['ca428776-c5dd-4dfb-a1b4-4b607344bd98'] Sep 04 01:06:10.223738 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:280 started Sep 04 01:06:10.226963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5537,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=618000000,duration_sec=579,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:06:10.227155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:06:10.227505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:280 - starting polling. Elapsed:0.004 Sep 04 01:06:10.230379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:10.234239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:280 - port information retrieved. Elapsed:0.011 Sep 04 01:06:10.238315 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:280 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.014 Sep 04 01:06:10.385440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-644f3c53-5db9-4d6d-ab42-8d1f4449b162 admin admin] Resource SecurityGroup deleted: ca428776-c5dd-4dfb-a1b4-4b607344bd98 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:10.386104 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-644f3c53-5db9-4d6d-ab42-8d1f4449b162 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (ca428776-c5dd-4dfb-a1b4-4b607344bd98), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:10.386645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-644f3c53-5db9-4d6d-ab42-8d1f4449b162 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('ca428776-c5dd-4dfb-a1b4-4b607344bd98',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:06:10.404872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-644f3c53-5db9-4d6d-ab42-8d1f4449b162 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('ca428776-c5dd-4dfb-a1b4-4b607344bd98',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:06:10.405541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-644f3c53-5db9-4d6d-ab42-8d1f4449b162 admin admin] Resource SecurityGroupRule deleted: 3885d0bc-a537-46e2-8353-205038108da5 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:10.406032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-644f3c53-5db9-4d6d-ab42-8d1f4449b162 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (3885d0bc-a537-46e2-8353-205038108da5), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:10.406433 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-644f3c53-5db9-4d6d-ab42-8d1f4449b162 admin admin] Security group rule updated ['ca428776-c5dd-4dfb-a1b4-4b607344bd98'] Sep 04 01:06:10.408344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-644f3c53-5db9-4d6d-ab42-8d1f4449b162 admin admin] Resource SecurityGroupRule deleted: 4221866a-4929-41aa-bbb9-6f54aa9d698a {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:10.408344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-644f3c53-5db9-4d6d-ab42-8d1f4449b162 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (4221866a-4929-41aa-bbb9-6f54aa9d698a), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:10.408344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-644f3c53-5db9-4d6d-ab42-8d1f4449b162 admin admin] Security group rule updated ['ca428776-c5dd-4dfb-a1b4-4b607344bd98'] Sep 04 01:06:10.408344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-644f3c53-5db9-4d6d-ab42-8d1f4449b162 admin admin] Resource SecurityGroupRule deleted: 9a31ee95-2cbf-4d5b-bdc8-cf6437db4721 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:10.408761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-644f3c53-5db9-4d6d-ab42-8d1f4449b162 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (9a31ee95-2cbf-4d5b-bdc8-cf6437db4721), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:10.409769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-644f3c53-5db9-4d6d-ab42-8d1f4449b162 admin admin] Security group rule updated ['ca428776-c5dd-4dfb-a1b4-4b607344bd98'] Sep 04 01:06:10.410616 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-644f3c53-5db9-4d6d-ab42-8d1f4449b162 admin admin] Resource SecurityGroupRule deleted: bb5c1f4d-13dc-41b3-9598-35ab0a35a87a {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:10.411042 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-644f3c53-5db9-4d6d-ab42-8d1f4449b162 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (bb5c1f4d-13dc-41b3-9598-35ab0a35a87a), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:10.411588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-644f3c53-5db9-4d6d-ab42-8d1f4449b162 admin admin] Security group rule updated ['ca428776-c5dd-4dfb-a1b4-4b607344bd98'] Sep 04 01:06:10.715582 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-f004a530-29a3-4ce6-9715-1e5ef1340dd4 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:06:10Z,description='Default security group',id=dc0a9024-ce6d-4440-a983-63b8cef08fe4,is_default=True,name='default',project_id='1e621e0c178344bd86a1cd86734c629f',revision_number=1,rules=[SecurityGroupRule(497c16ca-30ff-4fbb-b34a-5a3e24f65267),SecurityGroupRule(5a755bbc-0378-444c-93b2-7cd99f2aa383),SecurityGroupRule(a1c81e9a-c6eb-447d-85af-fc8a70579e2c),SecurityGroupRule(f6718ec1-f7d4-4033-96ca-0fe1c1bba7d6)],shared=False,stateful=True,updated_at=2022-09-04T01:06:10Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:10.716171 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-f004a530-29a3-4ce6-9715-1e5ef1340dd4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (dc0a9024-ce6d-4440-a983-63b8cef08fe4), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:10.716697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-f004a530-29a3-4ce6-9715-1e5ef1340dd4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:10Z,description=,direction='ingress',ethertype='IPv6',id=497c16ca-30ff-4fbb-b34a-5a3e24f65267,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1e621e0c178344bd86a1cd86734c629f',protocol=,remote_address_group_id=,remote_group_id=dc0a9024-ce6d-4440-a983-63b8cef08fe4,remote_ip_prefix=,revision_number=0,security_group_id=dc0a9024-ce6d-4440-a983-63b8cef08fe4,updated_at=2022-09-04T01:06:10Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:10.717103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-f004a530-29a3-4ce6-9715-1e5ef1340dd4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (497c16ca-30ff-4fbb-b34a-5a3e24f65267), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:10.717449 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-f004a530-29a3-4ce6-9715-1e5ef1340dd4 admin admin] Security group rule updated ['dc0a9024-ce6d-4440-a983-63b8cef08fe4'] Sep 04 01:06:10.718191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-f004a530-29a3-4ce6-9715-1e5ef1340dd4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:10Z,description=,direction='egress',ethertype='IPv4',id=5a755bbc-0378-444c-93b2-7cd99f2aa383,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1e621e0c178344bd86a1cd86734c629f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=dc0a9024-ce6d-4440-a983-63b8cef08fe4,updated_at=2022-09-04T01:06:10Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:10.718583 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-f004a530-29a3-4ce6-9715-1e5ef1340dd4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (5a755bbc-0378-444c-93b2-7cd99f2aa383), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:10.718916 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-f004a530-29a3-4ce6-9715-1e5ef1340dd4 admin admin] Security group rule updated ['dc0a9024-ce6d-4440-a983-63b8cef08fe4'] Sep 04 01:06:10.719811 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-f004a530-29a3-4ce6-9715-1e5ef1340dd4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:10Z,description=,direction='ingress',ethertype='IPv4',id=a1c81e9a-c6eb-447d-85af-fc8a70579e2c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1e621e0c178344bd86a1cd86734c629f',protocol=,remote_address_group_id=,remote_group_id=dc0a9024-ce6d-4440-a983-63b8cef08fe4,remote_ip_prefix=,revision_number=0,security_group_id=dc0a9024-ce6d-4440-a983-63b8cef08fe4,updated_at=2022-09-04T01:06:10Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:10.720175 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-f004a530-29a3-4ce6-9715-1e5ef1340dd4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (a1c81e9a-c6eb-447d-85af-fc8a70579e2c), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:10.720513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-f004a530-29a3-4ce6-9715-1e5ef1340dd4 admin admin] Security group rule updated ['dc0a9024-ce6d-4440-a983-63b8cef08fe4'] Sep 04 01:06:10.721279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-f004a530-29a3-4ce6-9715-1e5ef1340dd4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:10Z,description=,direction='egress',ethertype='IPv6',id=f6718ec1-f7d4-4033-96ca-0fe1c1bba7d6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1e621e0c178344bd86a1cd86734c629f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=dc0a9024-ce6d-4440-a983-63b8cef08fe4,updated_at=2022-09-04T01:06:10Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:10.721636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-f004a530-29a3-4ce6-9715-1e5ef1340dd4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (f6718ec1-f7d4-4033-96ca-0fe1c1bba7d6), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:10.722314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-f004a530-29a3-4ce6-9715-1e5ef1340dd4 admin admin] Security group rule updated ['dc0a9024-ce6d-4440-a983-63b8cef08fe4'] Sep 04 01:06:10.980629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-12df73a9-02d8-4ffe-9479-c81e69164eb9 admin admin] Resource SecurityGroup deleted: dc0a9024-ce6d-4440-a983-63b8cef08fe4 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:10.981349 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-12df73a9-02d8-4ffe-9479-c81e69164eb9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (dc0a9024-ce6d-4440-a983-63b8cef08fe4), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:10.982062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12df73a9-02d8-4ffe-9479-c81e69164eb9 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('dc0a9024-ce6d-4440-a983-63b8cef08fe4',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:06:11.166705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-12df73a9-02d8-4ffe-9479-c81e69164eb9 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('dc0a9024-ce6d-4440-a983-63b8cef08fe4',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:06:11.167405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-12df73a9-02d8-4ffe-9479-c81e69164eb9 admin admin] Resource SecurityGroupRule deleted: 497c16ca-30ff-4fbb-b34a-5a3e24f65267 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:11.167875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-12df73a9-02d8-4ffe-9479-c81e69164eb9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (497c16ca-30ff-4fbb-b34a-5a3e24f65267), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:11.168627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-12df73a9-02d8-4ffe-9479-c81e69164eb9 admin admin] Security group rule updated ['dc0a9024-ce6d-4440-a983-63b8cef08fe4'] Sep 04 01:06:11.169265 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-12df73a9-02d8-4ffe-9479-c81e69164eb9 admin admin] Resource SecurityGroupRule deleted: 5a755bbc-0378-444c-93b2-7cd99f2aa383 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:11.169832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-12df73a9-02d8-4ffe-9479-c81e69164eb9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (5a755bbc-0378-444c-93b2-7cd99f2aa383), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:11.170263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-12df73a9-02d8-4ffe-9479-c81e69164eb9 admin admin] Security group rule updated ['dc0a9024-ce6d-4440-a983-63b8cef08fe4'] Sep 04 01:06:11.170777 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-12df73a9-02d8-4ffe-9479-c81e69164eb9 admin admin] Resource SecurityGroupRule deleted: a1c81e9a-c6eb-447d-85af-fc8a70579e2c {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:11.171220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-12df73a9-02d8-4ffe-9479-c81e69164eb9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (a1c81e9a-c6eb-447d-85af-fc8a70579e2c), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:11.171636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-12df73a9-02d8-4ffe-9479-c81e69164eb9 admin admin] Security group rule updated ['dc0a9024-ce6d-4440-a983-63b8cef08fe4'] Sep 04 01:06:11.172166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-12df73a9-02d8-4ffe-9479-c81e69164eb9 admin admin] Resource SecurityGroupRule deleted: f6718ec1-f7d4-4033-96ca-0fe1c1bba7d6 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:11.172599 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-12df73a9-02d8-4ffe-9479-c81e69164eb9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (f6718ec1-f7d4-4033-96ca-0fe1c1bba7d6), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:11.173182 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-12df73a9-02d8-4ffe-9479-c81e69164eb9 admin admin] Security group rule updated ['dc0a9024-ce6d-4440-a983-63b8cef08fe4'] Sep 04 01:06:11.532575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-49c66c72-b50a-4233-bdf4-eea45351785d admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:06:11Z,description='Default security group',id=82bf1297-b07c-49f9-b70a-63c8cda8ee36,is_default=True,name='default',project_id='5d8ec7c6ee57418eb3a95d2e0b857f75',revision_number=1,rules=[SecurityGroupRule(35b2a0fd-5b3c-4d40-8f44-c0b29f6f6d0a),SecurityGroupRule(77c253e9-6f0c-4960-8d0d-0b6590a9c740),SecurityGroupRule(c6b62be8-c0e5-43f0-8cd0-7e2d2cc88d8d),SecurityGroupRule(f139b99a-f4d2-4189-aa49-124bb6006faf)],shared=False,stateful=True,updated_at=2022-09-04T01:06:11Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:11.533380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-49c66c72-b50a-4233-bdf4-eea45351785d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (82bf1297-b07c-49f9-b70a-63c8cda8ee36), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:11.534722 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-49c66c72-b50a-4233-bdf4-eea45351785d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:11Z,description=,direction='ingress',ethertype='IPv6',id=35b2a0fd-5b3c-4d40-8f44-c0b29f6f6d0a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5d8ec7c6ee57418eb3a95d2e0b857f75',protocol=,remote_address_group_id=,remote_group_id=82bf1297-b07c-49f9-b70a-63c8cda8ee36,remote_ip_prefix=,revision_number=0,security_group_id=82bf1297-b07c-49f9-b70a-63c8cda8ee36,updated_at=2022-09-04T01:06:11Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:11.535400 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-49c66c72-b50a-4233-bdf4-eea45351785d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (35b2a0fd-5b3c-4d40-8f44-c0b29f6f6d0a), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:11.536014 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-49c66c72-b50a-4233-bdf4-eea45351785d admin admin] Security group rule updated ['82bf1297-b07c-49f9-b70a-63c8cda8ee36'] Sep 04 01:06:11.537038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-49c66c72-b50a-4233-bdf4-eea45351785d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:11Z,description=,direction='ingress',ethertype='IPv4',id=77c253e9-6f0c-4960-8d0d-0b6590a9c740,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5d8ec7c6ee57418eb3a95d2e0b857f75',protocol=,remote_address_group_id=,remote_group_id=82bf1297-b07c-49f9-b70a-63c8cda8ee36,remote_ip_prefix=,revision_number=0,security_group_id=82bf1297-b07c-49f9-b70a-63c8cda8ee36,updated_at=2022-09-04T01:06:11Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:11.537769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-49c66c72-b50a-4233-bdf4-eea45351785d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (77c253e9-6f0c-4960-8d0d-0b6590a9c740), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:11.538247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-49c66c72-b50a-4233-bdf4-eea45351785d admin admin] Security group rule updated ['82bf1297-b07c-49f9-b70a-63c8cda8ee36'] Sep 04 01:06:11.539139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-49c66c72-b50a-4233-bdf4-eea45351785d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:11Z,description=,direction='egress',ethertype='IPv4',id=c6b62be8-c0e5-43f0-8cd0-7e2d2cc88d8d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5d8ec7c6ee57418eb3a95d2e0b857f75',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=82bf1297-b07c-49f9-b70a-63c8cda8ee36,updated_at=2022-09-04T01:06:11Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:11.539653 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-49c66c72-b50a-4233-bdf4-eea45351785d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (c6b62be8-c0e5-43f0-8cd0-7e2d2cc88d8d), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:11.541728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-49c66c72-b50a-4233-bdf4-eea45351785d admin admin] Security group rule updated ['82bf1297-b07c-49f9-b70a-63c8cda8ee36'] Sep 04 01:06:11.543530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-49c66c72-b50a-4233-bdf4-eea45351785d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:11Z,description=,direction='egress',ethertype='IPv6',id=f139b99a-f4d2-4189-aa49-124bb6006faf,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5d8ec7c6ee57418eb3a95d2e0b857f75',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=82bf1297-b07c-49f9-b70a-63c8cda8ee36,updated_at=2022-09-04T01:06:11Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:11.544219 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-49c66c72-b50a-4233-bdf4-eea45351785d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (f139b99a-f4d2-4189-aa49-124bb6006faf), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:11.545450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-49c66c72-b50a-4233-bdf4-eea45351785d admin admin] Security group rule updated ['82bf1297-b07c-49f9-b70a-63c8cda8ee36'] Sep 04 01:06:11.881494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Resource Port fcbc60fd-1785-4f94-9436-a520ec06cdaf updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:06:11.882217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (fcbc60fd-1785-4f94-9436-a520ec06cdaf), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:12.183792 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-3a198cc4-92ea-4649-b074-259293261e36 admin admin] Resource SecurityGroup deleted: 82bf1297-b07c-49f9-b70a-63c8cda8ee36 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:12.184603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-3a198cc4-92ea-4649-b074-259293261e36 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (82bf1297-b07c-49f9-b70a-63c8cda8ee36), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:12.185322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a198cc4-92ea-4649-b074-259293261e36 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('82bf1297-b07c-49f9-b70a-63c8cda8ee36',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:06:12.216060 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-3a198cc4-92ea-4649-b074-259293261e36 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('82bf1297-b07c-49f9-b70a-63c8cda8ee36',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:06:12.216792 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-3a198cc4-92ea-4649-b074-259293261e36 admin admin] Resource SecurityGroupRule deleted: 35b2a0fd-5b3c-4d40-8f44-c0b29f6f6d0a {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:12.217453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-3a198cc4-92ea-4649-b074-259293261e36 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (35b2a0fd-5b3c-4d40-8f44-c0b29f6f6d0a), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:12.217939 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-3a198cc4-92ea-4649-b074-259293261e36 admin admin] Security group rule updated ['82bf1297-b07c-49f9-b70a-63c8cda8ee36'] Sep 04 01:06:12.218544 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-3a198cc4-92ea-4649-b074-259293261e36 admin admin] Resource SecurityGroupRule deleted: 77c253e9-6f0c-4960-8d0d-0b6590a9c740 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:12.219037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-3a198cc4-92ea-4649-b074-259293261e36 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (77c253e9-6f0c-4960-8d0d-0b6590a9c740), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:12.219504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-3a198cc4-92ea-4649-b074-259293261e36 admin admin] Security group rule updated ['82bf1297-b07c-49f9-b70a-63c8cda8ee36'] Sep 04 01:06:12.220077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-3a198cc4-92ea-4649-b074-259293261e36 admin admin] Resource SecurityGroupRule deleted: c6b62be8-c0e5-43f0-8cd0-7e2d2cc88d8d {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:12.220428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-3a198cc4-92ea-4649-b074-259293261e36 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (c6b62be8-c0e5-43f0-8cd0-7e2d2cc88d8d), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:12.220751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-3a198cc4-92ea-4649-b074-259293261e36 admin admin] Security group rule updated ['82bf1297-b07c-49f9-b70a-63c8cda8ee36'] Sep 04 01:06:12.221197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-3a198cc4-92ea-4649-b074-259293261e36 admin admin] Resource SecurityGroupRule deleted: f139b99a-f4d2-4189-aa49-124bb6006faf {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:12.221540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-3a198cc4-92ea-4649-b074-259293261e36 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (f139b99a-f4d2-4189-aa49-124bb6006faf), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:12.221893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-3a198cc4-92ea-4649-b074-259293261e36 admin admin] Security group rule updated ['82bf1297-b07c-49f9-b70a-63c8cda8ee36'] Sep 04 01:06:12.226039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:281 started Sep 04 01:06:12.240064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5539,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=621000000,duration_sec=581,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:06:12.240938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:06:12.241336 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:281 - starting polling. Elapsed:0.016 Sep 04 01:06:12.243983 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:12.248008 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:281 - port information retrieved. Elapsed:0.022 Sep 04 01:06:12.248356 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:281 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.023 Sep 04 01:06:13.392559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-41c2d605-0469-46eb-b504-a0909dd77ce5 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:06:13Z,description='Default security group',id=7ce2e334-e540-42a4-a95e-48b49cce7edd,is_default=True,name='default',project_id='d30baef84b62499fac7cfe20946356ec',revision_number=1,rules=[SecurityGroupRule(34bd6a3f-9360-4a6f-8d60-a0eeb2157745),SecurityGroupRule(3fb7de06-e82f-4f58-8349-ac8845750fa3),SecurityGroupRule(6cef5a1e-3d18-4124-87c8-dffd5e473ab3),SecurityGroupRule(9bb518b1-1496-4ecf-86d9-a790dfe48316)],shared=False,stateful=True,updated_at=2022-09-04T01:06:13Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:13.393192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-41c2d605-0469-46eb-b504-a0909dd77ce5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (7ce2e334-e540-42a4-a95e-48b49cce7edd), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:13.395052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-41c2d605-0469-46eb-b504-a0909dd77ce5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:13Z,description=,direction='ingress',ethertype='IPv4',id=34bd6a3f-9360-4a6f-8d60-a0eeb2157745,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d30baef84b62499fac7cfe20946356ec',protocol=,remote_address_group_id=,remote_group_id=7ce2e334-e540-42a4-a95e-48b49cce7edd,remote_ip_prefix=,revision_number=0,security_group_id=7ce2e334-e540-42a4-a95e-48b49cce7edd,updated_at=2022-09-04T01:06:13Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:13.395434 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-41c2d605-0469-46eb-b504-a0909dd77ce5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (34bd6a3f-9360-4a6f-8d60-a0eeb2157745), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:13.396418 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-41c2d605-0469-46eb-b504-a0909dd77ce5 admin admin] Security group rule updated ['7ce2e334-e540-42a4-a95e-48b49cce7edd'] Sep 04 01:06:13.397205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-41c2d605-0469-46eb-b504-a0909dd77ce5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:13Z,description=,direction='egress',ethertype='IPv6',id=3fb7de06-e82f-4f58-8349-ac8845750fa3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d30baef84b62499fac7cfe20946356ec',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=7ce2e334-e540-42a4-a95e-48b49cce7edd,updated_at=2022-09-04T01:06:13Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:13.397564 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-41c2d605-0469-46eb-b504-a0909dd77ce5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (3fb7de06-e82f-4f58-8349-ac8845750fa3), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:13.397890 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-41c2d605-0469-46eb-b504-a0909dd77ce5 admin admin] Security group rule updated ['7ce2e334-e540-42a4-a95e-48b49cce7edd'] Sep 04 01:06:13.398677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-41c2d605-0469-46eb-b504-a0909dd77ce5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:13Z,description=,direction='ingress',ethertype='IPv6',id=6cef5a1e-3d18-4124-87c8-dffd5e473ab3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d30baef84b62499fac7cfe20946356ec',protocol=,remote_address_group_id=,remote_group_id=7ce2e334-e540-42a4-a95e-48b49cce7edd,remote_ip_prefix=,revision_number=0,security_group_id=7ce2e334-e540-42a4-a95e-48b49cce7edd,updated_at=2022-09-04T01:06:13Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:13.399064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-41c2d605-0469-46eb-b504-a0909dd77ce5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (6cef5a1e-3d18-4124-87c8-dffd5e473ab3), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:13.399398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-41c2d605-0469-46eb-b504-a0909dd77ce5 admin admin] Security group rule updated ['7ce2e334-e540-42a4-a95e-48b49cce7edd'] Sep 04 01:06:13.400096 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-41c2d605-0469-46eb-b504-a0909dd77ce5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:13Z,description=,direction='egress',ethertype='IPv4',id=9bb518b1-1496-4ecf-86d9-a790dfe48316,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d30baef84b62499fac7cfe20946356ec',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=7ce2e334-e540-42a4-a95e-48b49cce7edd,updated_at=2022-09-04T01:06:13Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:13.403352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-41c2d605-0469-46eb-b504-a0909dd77ce5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (9bb518b1-1496-4ecf-86d9-a790dfe48316), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:13.403722 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-41c2d605-0469-46eb-b504-a0909dd77ce5 admin admin] Security group rule updated ['7ce2e334-e540-42a4-a95e-48b49cce7edd'] Sep 04 01:06:13.616499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-2359a128-ea32-4393-b7a6-9df4e6d2f655 admin admin] Resource SecurityGroup deleted: 7ce2e334-e540-42a4-a95e-48b49cce7edd {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:13.617005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-2359a128-ea32-4393-b7a6-9df4e6d2f655 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (7ce2e334-e540-42a4-a95e-48b49cce7edd), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:13.617495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2359a128-ea32-4393-b7a6-9df4e6d2f655 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('7ce2e334-e540-42a4-a95e-48b49cce7edd',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:06:13.630949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-2359a128-ea32-4393-b7a6-9df4e6d2f655 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('7ce2e334-e540-42a4-a95e-48b49cce7edd',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:06:13.639069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-2359a128-ea32-4393-b7a6-9df4e6d2f655 admin admin] Resource SecurityGroupRule deleted: 34bd6a3f-9360-4a6f-8d60-a0eeb2157745 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:13.639069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-2359a128-ea32-4393-b7a6-9df4e6d2f655 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (34bd6a3f-9360-4a6f-8d60-a0eeb2157745), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:13.639069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-2359a128-ea32-4393-b7a6-9df4e6d2f655 admin admin] Security group rule updated ['7ce2e334-e540-42a4-a95e-48b49cce7edd'] Sep 04 01:06:13.639069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-2359a128-ea32-4393-b7a6-9df4e6d2f655 admin admin] Resource SecurityGroupRule deleted: 3fb7de06-e82f-4f58-8349-ac8845750fa3 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:13.639069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-2359a128-ea32-4393-b7a6-9df4e6d2f655 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (3fb7de06-e82f-4f58-8349-ac8845750fa3), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:13.639547 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-2359a128-ea32-4393-b7a6-9df4e6d2f655 admin admin] Security group rule updated ['7ce2e334-e540-42a4-a95e-48b49cce7edd'] Sep 04 01:06:13.639547 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-2359a128-ea32-4393-b7a6-9df4e6d2f655 admin admin] Resource SecurityGroupRule deleted: 6cef5a1e-3d18-4124-87c8-dffd5e473ab3 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:13.639547 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-2359a128-ea32-4393-b7a6-9df4e6d2f655 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (6cef5a1e-3d18-4124-87c8-dffd5e473ab3), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:13.639547 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-2359a128-ea32-4393-b7a6-9df4e6d2f655 admin admin] Security group rule updated ['7ce2e334-e540-42a4-a95e-48b49cce7edd'] Sep 04 01:06:13.639547 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-2359a128-ea32-4393-b7a6-9df4e6d2f655 admin admin] Resource SecurityGroupRule deleted: 9bb518b1-1496-4ecf-86d9-a790dfe48316 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:13.639875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-2359a128-ea32-4393-b7a6-9df4e6d2f655 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (9bb518b1-1496-4ecf-86d9-a790dfe48316), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:13.639875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-2359a128-ea32-4393-b7a6-9df4e6d2f655 admin admin] Security group rule updated ['7ce2e334-e540-42a4-a95e-48b49cce7edd'] Sep 04 01:06:14.227319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:282 started Sep 04 01:06:14.232037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade553b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=623000000,duration_sec=583,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:06:14.233210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:06:14.233771 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:282 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 04 01:06:14.365058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-05d40b7d-9acc-47b0-a07f-40b92cdf0594 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:06:14Z,description='Default security group',id=1672ad9f-131d-466c-9fb1-fd7295010a34,is_default=True,name='default',project_id='e53f2763660041c5909c9e61a27f078c',revision_number=1,rules=[SecurityGroupRule(2ac3523b-26bc-4ddc-b292-b6452b7b6d04),SecurityGroupRule(623239ac-86ca-4fd4-a726-9b2525eed992),SecurityGroupRule(d9f2543a-fc39-4d32-a6f1-586da6cdb4b3),SecurityGroupRule(fcff3fcb-42de-424f-b0a8-7223977109a2)],shared=False,stateful=True,updated_at=2022-09-04T01:06:14Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:14.365058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-05d40b7d-9acc-47b0-a07f-40b92cdf0594 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (1672ad9f-131d-466c-9fb1-fd7295010a34), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:14.365058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-05d40b7d-9acc-47b0-a07f-40b92cdf0594 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:14Z,description=,direction='egress',ethertype='IPv4',id=2ac3523b-26bc-4ddc-b292-b6452b7b6d04,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e53f2763660041c5909c9e61a27f078c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=1672ad9f-131d-466c-9fb1-fd7295010a34,updated_at=2022-09-04T01:06:14Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:14.365813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-05d40b7d-9acc-47b0-a07f-40b92cdf0594 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (2ac3523b-26bc-4ddc-b292-b6452b7b6d04), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:14.365813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-05d40b7d-9acc-47b0-a07f-40b92cdf0594 admin admin] Security group rule updated ['1672ad9f-131d-466c-9fb1-fd7295010a34'] Sep 04 01:06:14.367094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-05d40b7d-9acc-47b0-a07f-40b92cdf0594 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:14Z,description=,direction='egress',ethertype='IPv6',id=623239ac-86ca-4fd4-a726-9b2525eed992,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e53f2763660041c5909c9e61a27f078c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=1672ad9f-131d-466c-9fb1-fd7295010a34,updated_at=2022-09-04T01:06:14Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:14.367452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-05d40b7d-9acc-47b0-a07f-40b92cdf0594 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (623239ac-86ca-4fd4-a726-9b2525eed992), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:14.367780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-05d40b7d-9acc-47b0-a07f-40b92cdf0594 admin admin] Security group rule updated ['1672ad9f-131d-466c-9fb1-fd7295010a34'] Sep 04 01:06:14.368601 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-05d40b7d-9acc-47b0-a07f-40b92cdf0594 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:14Z,description=,direction='ingress',ethertype='IPv6',id=d9f2543a-fc39-4d32-a6f1-586da6cdb4b3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e53f2763660041c5909c9e61a27f078c',protocol=,remote_address_group_id=,remote_group_id=1672ad9f-131d-466c-9fb1-fd7295010a34,remote_ip_prefix=,revision_number=0,security_group_id=1672ad9f-131d-466c-9fb1-fd7295010a34,updated_at=2022-09-04T01:06:14Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:14.369697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-05d40b7d-9acc-47b0-a07f-40b92cdf0594 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (d9f2543a-fc39-4d32-a6f1-586da6cdb4b3), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:14.370034 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-05d40b7d-9acc-47b0-a07f-40b92cdf0594 admin admin] Security group rule updated ['1672ad9f-131d-466c-9fb1-fd7295010a34'] Sep 04 01:06:14.373587 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-05d40b7d-9acc-47b0-a07f-40b92cdf0594 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:14Z,description=,direction='ingress',ethertype='IPv4',id=fcff3fcb-42de-424f-b0a8-7223977109a2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e53f2763660041c5909c9e61a27f078c',protocol=,remote_address_group_id=,remote_group_id=1672ad9f-131d-466c-9fb1-fd7295010a34,remote_ip_prefix=,revision_number=0,security_group_id=1672ad9f-131d-466c-9fb1-fd7295010a34,updated_at=2022-09-04T01:06:14Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:14.373959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-05d40b7d-9acc-47b0-a07f-40b92cdf0594 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (fcff3fcb-42de-424f-b0a8-7223977109a2), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:14.374297 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-05d40b7d-9acc-47b0-a07f-40b92cdf0594 admin admin] Security group rule updated ['1672ad9f-131d-466c-9fb1-fd7295010a34'] Sep 04 01:06:14.703893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-cea2dddf-25fc-419a-9572-6c70b6f15e33 admin admin] Resource SecurityGroup deleted: 1672ad9f-131d-466c-9fb1-fd7295010a34 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:14.704447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-cea2dddf-25fc-419a-9572-6c70b6f15e33 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (1672ad9f-131d-466c-9fb1-fd7295010a34), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:14.704874 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cea2dddf-25fc-419a-9572-6c70b6f15e33 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('1672ad9f-131d-466c-9fb1-fd7295010a34',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:06:14.721095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-cea2dddf-25fc-419a-9572-6c70b6f15e33 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('1672ad9f-131d-466c-9fb1-fd7295010a34',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:06:14.722137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-cea2dddf-25fc-419a-9572-6c70b6f15e33 admin admin] Resource SecurityGroupRule deleted: 2ac3523b-26bc-4ddc-b292-b6452b7b6d04 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:14.722682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-cea2dddf-25fc-419a-9572-6c70b6f15e33 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (2ac3523b-26bc-4ddc-b292-b6452b7b6d04), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:14.723056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-cea2dddf-25fc-419a-9572-6c70b6f15e33 admin admin] Security group rule updated ['1672ad9f-131d-466c-9fb1-fd7295010a34'] Sep 04 01:06:14.723451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-cea2dddf-25fc-419a-9572-6c70b6f15e33 admin admin] Resource SecurityGroupRule deleted: 623239ac-86ca-4fd4-a726-9b2525eed992 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:14.723948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-cea2dddf-25fc-419a-9572-6c70b6f15e33 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (623239ac-86ca-4fd4-a726-9b2525eed992), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:14.724272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-cea2dddf-25fc-419a-9572-6c70b6f15e33 admin admin] Security group rule updated ['1672ad9f-131d-466c-9fb1-fd7295010a34'] Sep 04 01:06:14.724684 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-cea2dddf-25fc-419a-9572-6c70b6f15e33 admin admin] Resource SecurityGroupRule deleted: d9f2543a-fc39-4d32-a6f1-586da6cdb4b3 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:14.725021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-cea2dddf-25fc-419a-9572-6c70b6f15e33 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (d9f2543a-fc39-4d32-a6f1-586da6cdb4b3), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:14.725356 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-cea2dddf-25fc-419a-9572-6c70b6f15e33 admin admin] Security group rule updated ['1672ad9f-131d-466c-9fb1-fd7295010a34'] Sep 04 01:06:14.725808 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-cea2dddf-25fc-419a-9572-6c70b6f15e33 admin admin] Resource SecurityGroupRule deleted: fcff3fcb-42de-424f-b0a8-7223977109a2 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:14.726152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-cea2dddf-25fc-419a-9572-6c70b6f15e33 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (fcff3fcb-42de-424f-b0a8-7223977109a2), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:14.726463 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-cea2dddf-25fc-419a-9572-6c70b6f15e33 admin admin] Security group rule updated ['1672ad9f-131d-466c-9fb1-fd7295010a34'] Sep 04 01:06:16.228441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:283 started Sep 04 01:06:16.230935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade553d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=622000000,duration_sec=585,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:06:16.231527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:06:16.231881 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:283 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:06:18.229243 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:284 started Sep 04 01:06:18.231720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade553f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=623000000,duration_sec=587,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:06:18.232405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:06:18.232854 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:284 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:06:20.230743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:285 started Sep 04 01:06:20.242462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5541,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=625000000,duration_sec=589,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:06:20.242462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:06:20.242462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:285 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:06:21.650163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-6c70e983-4bf6-48c7-91eb-766e1425ee63 tempest-VolumesNegativeTest-1515737641 tempest-VolumesNegativeTest-1515737641-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:06:21Z,description='Default security group',id=895e5321-ec4e-448d-8f9a-e84e7b053e04,is_default=True,name='default',project_id='528d5c15cc47445dbe46761067a1c54a',revision_number=1,rules=[SecurityGroupRule(1c1de0d9-ca04-45cd-8434-bdc8078e1884),SecurityGroupRule(3b987559-2c9c-4021-bdf4-a1b6ec577b26),SecurityGroupRule(dd4c02d5-2845-4a8a-ab0e-3b053caa4d01),SecurityGroupRule(f5de877b-4d14-4781-8065-a8d13dd99d3e)],shared=False,stateful=True,updated_at=2022-09-04T01:06:21Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:21.650815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-6c70e983-4bf6-48c7-91eb-766e1425ee63 tempest-VolumesNegativeTest-1515737641 tempest-VolumesNegativeTest-1515737641-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (895e5321-ec4e-448d-8f9a-e84e7b053e04), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:21.651134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-6c70e983-4bf6-48c7-91eb-766e1425ee63 tempest-VolumesNegativeTest-1515737641 tempest-VolumesNegativeTest-1515737641-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:21Z,description=,direction='ingress',ethertype='IPv4',id=1c1de0d9-ca04-45cd-8434-bdc8078e1884,normalized_cidr=None,port_range_max=,port_range_min=,project_id='528d5c15cc47445dbe46761067a1c54a',protocol=,remote_address_group_id=,remote_group_id=895e5321-ec4e-448d-8f9a-e84e7b053e04,remote_ip_prefix=,revision_number=0,security_group_id=895e5321-ec4e-448d-8f9a-e84e7b053e04,updated_at=2022-09-04T01:06:21Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:21.651698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-6c70e983-4bf6-48c7-91eb-766e1425ee63 tempest-VolumesNegativeTest-1515737641 tempest-VolumesNegativeTest-1515737641-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (1c1de0d9-ca04-45cd-8434-bdc8078e1884), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:21.651965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-6c70e983-4bf6-48c7-91eb-766e1425ee63 tempest-VolumesNegativeTest-1515737641 tempest-VolumesNegativeTest-1515737641-project] Security group rule updated ['895e5321-ec4e-448d-8f9a-e84e7b053e04'] Sep 04 01:06:21.652719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-6c70e983-4bf6-48c7-91eb-766e1425ee63 tempest-VolumesNegativeTest-1515737641 tempest-VolumesNegativeTest-1515737641-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:21Z,description=,direction='egress',ethertype='IPv4',id=3b987559-2c9c-4021-bdf4-a1b6ec577b26,normalized_cidr=None,port_range_max=,port_range_min=,project_id='528d5c15cc47445dbe46761067a1c54a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=895e5321-ec4e-448d-8f9a-e84e7b053e04,updated_at=2022-09-04T01:06:21Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:21.653067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-6c70e983-4bf6-48c7-91eb-766e1425ee63 tempest-VolumesNegativeTest-1515737641 tempest-VolumesNegativeTest-1515737641-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (3b987559-2c9c-4021-bdf4-a1b6ec577b26), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:21.653447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-6c70e983-4bf6-48c7-91eb-766e1425ee63 tempest-VolumesNegativeTest-1515737641 tempest-VolumesNegativeTest-1515737641-project] Security group rule updated ['895e5321-ec4e-448d-8f9a-e84e7b053e04'] Sep 04 01:06:21.654142 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-6c70e983-4bf6-48c7-91eb-766e1425ee63 tempest-VolumesNegativeTest-1515737641 tempest-VolumesNegativeTest-1515737641-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:21Z,description=,direction='ingress',ethertype='IPv6',id=dd4c02d5-2845-4a8a-ab0e-3b053caa4d01,normalized_cidr=None,port_range_max=,port_range_min=,project_id='528d5c15cc47445dbe46761067a1c54a',protocol=,remote_address_group_id=,remote_group_id=895e5321-ec4e-448d-8f9a-e84e7b053e04,remote_ip_prefix=,revision_number=0,security_group_id=895e5321-ec4e-448d-8f9a-e84e7b053e04,updated_at=2022-09-04T01:06:21Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:21.654489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-6c70e983-4bf6-48c7-91eb-766e1425ee63 tempest-VolumesNegativeTest-1515737641 tempest-VolumesNegativeTest-1515737641-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (dd4c02d5-2845-4a8a-ab0e-3b053caa4d01), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:21.656844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-6c70e983-4bf6-48c7-91eb-766e1425ee63 tempest-VolumesNegativeTest-1515737641 tempest-VolumesNegativeTest-1515737641-project] Security group rule updated ['895e5321-ec4e-448d-8f9a-e84e7b053e04'] Sep 04 01:06:21.656844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-6c70e983-4bf6-48c7-91eb-766e1425ee63 tempest-VolumesNegativeTest-1515737641 tempest-VolumesNegativeTest-1515737641-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:21Z,description=,direction='egress',ethertype='IPv6',id=f5de877b-4d14-4781-8065-a8d13dd99d3e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='528d5c15cc47445dbe46761067a1c54a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=895e5321-ec4e-448d-8f9a-e84e7b053e04,updated_at=2022-09-04T01:06:21Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:21.656844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-6c70e983-4bf6-48c7-91eb-766e1425ee63 tempest-VolumesNegativeTest-1515737641 tempest-VolumesNegativeTest-1515737641-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (f5de877b-4d14-4781-8065-a8d13dd99d3e), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:21.656844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-6c70e983-4bf6-48c7-91eb-766e1425ee63 tempest-VolumesNegativeTest-1515737641 tempest-VolumesNegativeTest-1515737641-project] Security group rule updated ['895e5321-ec4e-448d-8f9a-e84e7b053e04'] Sep 04 01:06:22.029036 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-6c70e983-4bf6-48c7-91eb-766e1425ee63 tempest-VolumesNegativeTest-1515737641 tempest-VolumesNegativeTest-1515737641-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:06:21Z,data_plane_status=None,description='',device_id='aea3d71b-c26e-4e64-a3d4-e2ae5cfa25d8',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=0af19f52-43e4-40ca-848a-d2902c3e8205,mac_address=fa:16:3e:0e:46:c5,name='',network_id=4691c8cf-0c39-4045-a03b-ff5044c49d0a,numa_affinity_policy=,project_id='528d5c15cc47445dbe46761067a1c54a',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(0af19f52-43e4-40ca-848a-d2902c3e8205),security_group_ids=set([895e5321-ec4e-448d-8f9a-e84e7b053e04]),status='DOWN',updated_at=2022-09-04T01:06:21Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:22.029580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-6c70e983-4bf6-48c7-91eb-766e1425ee63 tempest-VolumesNegativeTest-1515737641 tempest-VolumesNegativeTest-1515737641-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (0af19f52-43e4-40ca-848a-d2902c3e8205), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:22.030209 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-6c70e983-4bf6-48c7-91eb-766e1425ee63 tempest-VolumesNegativeTest-1515737641 tempest-VolumesNegativeTest-1515737641-project] Security group member updated {'895e5321-ec4e-448d-8f9a-e84e7b053e04'} Sep 04 01:06:22.232203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:286 started Sep 04 01:06:22.235281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5543,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=627000000,duration_sec=591,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:06:22.236405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:06:22.237336 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:286 - starting polling. Elapsed:0.005 Sep 04 01:06:22.243855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:22.252203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:286 - port information retrieved. Elapsed:0.020 Sep 04 01:06:22.254782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:286 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.020 Sep 04 01:06:22.866894 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-1d5aab78-e426-48bb-b59d-fd2aaf412f3d service neutron] Resource Port 0af19f52-43e4-40ca-848a-d2902c3e8205 updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=0af19f52-43e4-40ca-848a-d2902c3e8205,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=0af19f52-43e4-40ca-848a-d2902c3e8205,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:06:22.867507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-1d5aab78-e426-48bb-b59d-fd2aaf412f3d service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (0af19f52-43e4-40ca-848a-d2902c3e8205), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:23.099666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-1d5aab78-e426-48bb-b59d-fd2aaf412f3d service neutron] Resource Port 0af19f52-43e4-40ca-848a-d2902c3e8205 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=0af19f52-43e4-40ca-848a-d2902c3e8205,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=0af19f52-43e4-40ca-848a-d2902c3e8205,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=0af19f52-43e4-40ca-848a-d2902c3e8205,segment=NetworkSegment(4e19c3f3-3b44-45ba-bb23-f26c22c581ca),segment_id=4e19c3f3-3b44-45ba-bb23-f26c22c581ca)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:06:23.100051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-1d5aab78-e426-48bb-b59d-fd2aaf412f3d service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (0af19f52-43e4-40ca-848a-d2902c3e8205), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:24.236185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:287 started Sep 04 01:06:24.238682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5545,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=630000000,duration_sec=593,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:06:24.239277 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:06:24.239605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:287 - starting polling. Elapsed:0.004 Sep 04 01:06:24.242205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:24.245699 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:287 - port information retrieved. Elapsed:0.010 Sep 04 01:06:24.246021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:287 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Sep 04 01:06:26.237675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:288 started Sep 04 01:06:26.240681 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5547,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=632000000,duration_sec=595,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:06:26.241382 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:06:26.241899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:288 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:06:28.213622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-7a953c0f-73f6-4ebe-b29e-3b222ea8c47d tempest-DeleteServersTestJSON-1716711868 tempest-DeleteServersTestJSON-1716711868-project] Resource Port deleted: 5d2b3e83-c7f4-4359-8491-abf0d6e3eec3 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:28.214141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-7a953c0f-73f6-4ebe-b29e-3b222ea8c47d tempest-DeleteServersTestJSON-1716711868 tempest-DeleteServersTestJSON-1716711868-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (5d2b3e83-c7f4-4359-8491-abf0d6e3eec3), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:28.214395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-7a953c0f-73f6-4ebe-b29e-3b222ea8c47d tempest-DeleteServersTestJSON-1716711868 tempest-DeleteServersTestJSON-1716711868-project] Security group member updated {'703cb105-947c-42c1-9237-d9f950459033'} Sep 04 01:06:28.238360 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:289 started Sep 04 01:06:28.240896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5549,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=632000000,duration_sec=597,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:06:28.241488 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:06:28.241820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:289 - starting polling. Elapsed:0.004 Sep 04 01:06:28.244401 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:28.246469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 5d2b3e83-c7f4-4359-8491-abf0d6e3eec3 not present in bridge br-int Sep 04 01:06:28.250709 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] net_uuid None not managed by VLAN manager Sep 04 01:06:28.250709 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for ['5d2b3e83-c7f4-4359-8491-abf0d6e3eec3'] Sep 04 01:06:28.250709 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 5d2b3e83-c7f4-4359-8491-abf0d6e3eec3 is not handled by the firewall. {{(pid=107812) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 04 01:06:28.251716 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:289 - port information retrieved. Elapsed:0.013 Sep 04 01:06:28.253012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:289 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.014 Sep 04 01:06:29.291710 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Resource Port 0af19f52-43e4-40ca-848a-d2902c3e8205 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:06:29.292810 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (0af19f52-43e4-40ca-848a-d2902c3e8205), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:29.416369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b48f3b50-0eb5-4942-b048-f944f2e66bbd admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:06:29Z,description='Default security group',id=cb8d1df4-fed6-4e0d-9028-007c4f434ac9,is_default=True,name='default',project_id='3bc2a6c837a3432b93fd02aefaf735dc',revision_number=1,rules=[SecurityGroupRule(3d029219-b17b-4749-8c6a-2c8dc740f62d),SecurityGroupRule(60596f86-5545-4d58-8f5e-343f5315da44),SecurityGroupRule(da5e8fbf-b491-435b-9c9c-2c45f1a15d5e),SecurityGroupRule(fa651011-c8e3-49c7-8ad4-e53ba9081249)],shared=False,stateful=True,updated_at=2022-09-04T01:06:29Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:29.417125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b48f3b50-0eb5-4942-b048-f944f2e66bbd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (cb8d1df4-fed6-4e0d-9028-007c4f434ac9), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:29.418198 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b48f3b50-0eb5-4942-b048-f944f2e66bbd admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:29Z,description=,direction='ingress',ethertype='IPv6',id=3d029219-b17b-4749-8c6a-2c8dc740f62d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3bc2a6c837a3432b93fd02aefaf735dc',protocol=,remote_address_group_id=,remote_group_id=cb8d1df4-fed6-4e0d-9028-007c4f434ac9,remote_ip_prefix=,revision_number=0,security_group_id=cb8d1df4-fed6-4e0d-9028-007c4f434ac9,updated_at=2022-09-04T01:06:29Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:29.418570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b48f3b50-0eb5-4942-b048-f944f2e66bbd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (3d029219-b17b-4749-8c6a-2c8dc740f62d), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:29.418912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-b48f3b50-0eb5-4942-b048-f944f2e66bbd admin admin] Security group rule updated ['cb8d1df4-fed6-4e0d-9028-007c4f434ac9'] Sep 04 01:06:29.419635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b48f3b50-0eb5-4942-b048-f944f2e66bbd admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:29Z,description=,direction='egress',ethertype='IPv6',id=60596f86-5545-4d58-8f5e-343f5315da44,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3bc2a6c837a3432b93fd02aefaf735dc',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=cb8d1df4-fed6-4e0d-9028-007c4f434ac9,updated_at=2022-09-04T01:06:29Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:29.419991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b48f3b50-0eb5-4942-b048-f944f2e66bbd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (60596f86-5545-4d58-8f5e-343f5315da44), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:29.420326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-b48f3b50-0eb5-4942-b048-f944f2e66bbd admin admin] Security group rule updated ['cb8d1df4-fed6-4e0d-9028-007c4f434ac9'] Sep 04 01:06:29.421234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b48f3b50-0eb5-4942-b048-f944f2e66bbd admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:29Z,description=,direction='ingress',ethertype='IPv4',id=da5e8fbf-b491-435b-9c9c-2c45f1a15d5e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3bc2a6c837a3432b93fd02aefaf735dc',protocol=,remote_address_group_id=,remote_group_id=cb8d1df4-fed6-4e0d-9028-007c4f434ac9,remote_ip_prefix=,revision_number=0,security_group_id=cb8d1df4-fed6-4e0d-9028-007c4f434ac9,updated_at=2022-09-04T01:06:29Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:29.421583 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b48f3b50-0eb5-4942-b048-f944f2e66bbd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (da5e8fbf-b491-435b-9c9c-2c45f1a15d5e), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:29.421964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-b48f3b50-0eb5-4942-b048-f944f2e66bbd admin admin] Security group rule updated ['cb8d1df4-fed6-4e0d-9028-007c4f434ac9'] Sep 04 01:06:29.422833 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b48f3b50-0eb5-4942-b048-f944f2e66bbd admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:29Z,description=,direction='egress',ethertype='IPv4',id=fa651011-c8e3-49c7-8ad4-e53ba9081249,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3bc2a6c837a3432b93fd02aefaf735dc',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=cb8d1df4-fed6-4e0d-9028-007c4f434ac9,updated_at=2022-09-04T01:06:29Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:29.423185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b48f3b50-0eb5-4942-b048-f944f2e66bbd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (fa651011-c8e3-49c7-8ad4-e53ba9081249), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:29.423508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-b48f3b50-0eb5-4942-b048-f944f2e66bbd admin admin] Security group rule updated ['cb8d1df4-fed6-4e0d-9028-007c4f434ac9'] Sep 04 01:06:29.654869 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-624920e4-1bfe-4a42-a0cc-20127651a722 admin admin] Resource SecurityGroup deleted: cb8d1df4-fed6-4e0d-9028-007c4f434ac9 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:29.655505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-624920e4-1bfe-4a42-a0cc-20127651a722 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (cb8d1df4-fed6-4e0d-9028-007c4f434ac9), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:29.656172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-624920e4-1bfe-4a42-a0cc-20127651a722 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('cb8d1df4-fed6-4e0d-9028-007c4f434ac9',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:06:29.672928 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-624920e4-1bfe-4a42-a0cc-20127651a722 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('cb8d1df4-fed6-4e0d-9028-007c4f434ac9',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:06:29.675144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-624920e4-1bfe-4a42-a0cc-20127651a722 admin admin] Resource SecurityGroupRule deleted: 3d029219-b17b-4749-8c6a-2c8dc740f62d {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:29.675144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-624920e4-1bfe-4a42-a0cc-20127651a722 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (3d029219-b17b-4749-8c6a-2c8dc740f62d), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:29.675144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-624920e4-1bfe-4a42-a0cc-20127651a722 admin admin] Security group rule updated ['cb8d1df4-fed6-4e0d-9028-007c4f434ac9'] Sep 04 01:06:29.676149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-624920e4-1bfe-4a42-a0cc-20127651a722 admin admin] Resource SecurityGroupRule deleted: 60596f86-5545-4d58-8f5e-343f5315da44 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:29.676782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-624920e4-1bfe-4a42-a0cc-20127651a722 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (60596f86-5545-4d58-8f5e-343f5315da44), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:29.677424 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-624920e4-1bfe-4a42-a0cc-20127651a722 admin admin] Security group rule updated ['cb8d1df4-fed6-4e0d-9028-007c4f434ac9'] Sep 04 01:06:29.678298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-624920e4-1bfe-4a42-a0cc-20127651a722 admin admin] Resource SecurityGroupRule deleted: da5e8fbf-b491-435b-9c9c-2c45f1a15d5e {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:29.678754 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-624920e4-1bfe-4a42-a0cc-20127651a722 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (da5e8fbf-b491-435b-9c9c-2c45f1a15d5e), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:29.679085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-624920e4-1bfe-4a42-a0cc-20127651a722 admin admin] Security group rule updated ['cb8d1df4-fed6-4e0d-9028-007c4f434ac9'] Sep 04 01:06:29.679505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-624920e4-1bfe-4a42-a0cc-20127651a722 admin admin] Resource SecurityGroupRule deleted: fa651011-c8e3-49c7-8ad4-e53ba9081249 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:29.679846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-624920e4-1bfe-4a42-a0cc-20127651a722 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (fa651011-c8e3-49c7-8ad4-e53ba9081249), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:29.680168 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-624920e4-1bfe-4a42-a0cc-20127651a722 admin admin] Security group rule updated ['cb8d1df4-fed6-4e0d-9028-007c4f434ac9'] Sep 04 01:06:30.240565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:290 started Sep 04 01:06:30.244889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade554b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=635000000,duration_sec=599,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:06:30.245748 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:06:30.246286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:290 - starting polling. Elapsed:0.006 Sep 04 01:06:30.249383 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:30.253565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:290 - port information retrieved. Elapsed:0.013 Sep 04 01:06:30.254178 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:290 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.014 Sep 04 01:06:30.609735 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4bb32dbb-cfe0-47c5-aea5-5641c215de7f admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:06:30Z,description='Default security group',id=5d556b1a-abc6-4c4c-81f1-574f88cc44cb,is_default=True,name='default',project_id='746196b139864c45b9917cca6e7c8f79',revision_number=1,rules=[SecurityGroupRule(0135a52d-f4fe-4ebd-9127-6fc075945947),SecurityGroupRule(4b84ae99-a41a-42fa-9301-0321208e6fbb),SecurityGroupRule(4f710d84-a7b5-4252-9c6b-d442ebcfc4c3),SecurityGroupRule(4f91c951-de51-4fd3-80c3-03f652cf9f31)],shared=False,stateful=True,updated_at=2022-09-04T01:06:30Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:30.610654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4bb32dbb-cfe0-47c5-aea5-5641c215de7f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (5d556b1a-abc6-4c4c-81f1-574f88cc44cb), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:30.611604 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4bb32dbb-cfe0-47c5-aea5-5641c215de7f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:30Z,description=,direction='ingress',ethertype='IPv4',id=0135a52d-f4fe-4ebd-9127-6fc075945947,normalized_cidr=None,port_range_max=,port_range_min=,project_id='746196b139864c45b9917cca6e7c8f79',protocol=,remote_address_group_id=,remote_group_id=5d556b1a-abc6-4c4c-81f1-574f88cc44cb,remote_ip_prefix=,revision_number=0,security_group_id=5d556b1a-abc6-4c4c-81f1-574f88cc44cb,updated_at=2022-09-04T01:06:30Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:30.612357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4bb32dbb-cfe0-47c5-aea5-5641c215de7f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (0135a52d-f4fe-4ebd-9127-6fc075945947), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:30.612892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-4bb32dbb-cfe0-47c5-aea5-5641c215de7f admin admin] Security group rule updated ['5d556b1a-abc6-4c4c-81f1-574f88cc44cb'] Sep 04 01:06:30.613956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4bb32dbb-cfe0-47c5-aea5-5641c215de7f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:30Z,description=,direction='egress',ethertype='IPv4',id=4b84ae99-a41a-42fa-9301-0321208e6fbb,normalized_cidr=None,port_range_max=,port_range_min=,project_id='746196b139864c45b9917cca6e7c8f79',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=5d556b1a-abc6-4c4c-81f1-574f88cc44cb,updated_at=2022-09-04T01:06:30Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:30.614423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4bb32dbb-cfe0-47c5-aea5-5641c215de7f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (4b84ae99-a41a-42fa-9301-0321208e6fbb), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:30.614725 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-4bb32dbb-cfe0-47c5-aea5-5641c215de7f admin admin] Security group rule updated ['5d556b1a-abc6-4c4c-81f1-574f88cc44cb'] Sep 04 01:06:30.615355 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4bb32dbb-cfe0-47c5-aea5-5641c215de7f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:30Z,description=,direction='egress',ethertype='IPv6',id=4f710d84-a7b5-4252-9c6b-d442ebcfc4c3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='746196b139864c45b9917cca6e7c8f79',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=5d556b1a-abc6-4c4c-81f1-574f88cc44cb,updated_at=2022-09-04T01:06:30Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:30.615701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4bb32dbb-cfe0-47c5-aea5-5641c215de7f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (4f710d84-a7b5-4252-9c6b-d442ebcfc4c3), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:30.616024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-4bb32dbb-cfe0-47c5-aea5-5641c215de7f admin admin] Security group rule updated ['5d556b1a-abc6-4c4c-81f1-574f88cc44cb'] Sep 04 01:06:30.616720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4bb32dbb-cfe0-47c5-aea5-5641c215de7f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:30Z,description=,direction='ingress',ethertype='IPv6',id=4f91c951-de51-4fd3-80c3-03f652cf9f31,normalized_cidr=None,port_range_max=,port_range_min=,project_id='746196b139864c45b9917cca6e7c8f79',protocol=,remote_address_group_id=,remote_group_id=5d556b1a-abc6-4c4c-81f1-574f88cc44cb,remote_ip_prefix=,revision_number=0,security_group_id=5d556b1a-abc6-4c4c-81f1-574f88cc44cb,updated_at=2022-09-04T01:06:30Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:30.617091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4bb32dbb-cfe0-47c5-aea5-5641c215de7f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (4f91c951-de51-4fd3-80c3-03f652cf9f31), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:30.617419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-4bb32dbb-cfe0-47c5-aea5-5641c215de7f admin admin] Security group rule updated ['5d556b1a-abc6-4c4c-81f1-574f88cc44cb'] Sep 04 01:06:30.718254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-fbe26bad-f02d-46fa-be10-89a7e7b672f8 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:06:30Z,description='Default security group',id=b58146b2-0fad-460a-99da-0145ccd8ad44,is_default=True,name='default',project_id='2bea56a7089f4fa189405ee93b0993e5',revision_number=1,rules=[SecurityGroupRule(734f5ef1-72b5-430b-bac8-4e198eff158c),SecurityGroupRule(974d4d04-5321-463b-9099-7c8fc0311484),SecurityGroupRule(aca7f00d-01cd-4d2f-9a04-c37beee8875f),SecurityGroupRule(c450878c-5cc4-4939-9bf9-4c3ce1df7327)],shared=False,stateful=True,updated_at=2022-09-04T01:06:30Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:30.718934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-fbe26bad-f02d-46fa-be10-89a7e7b672f8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (b58146b2-0fad-460a-99da-0145ccd8ad44), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:30.719472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-fbe26bad-f02d-46fa-be10-89a7e7b672f8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:30Z,description=,direction='ingress',ethertype='IPv4',id=734f5ef1-72b5-430b-bac8-4e198eff158c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2bea56a7089f4fa189405ee93b0993e5',protocol=,remote_address_group_id=,remote_group_id=b58146b2-0fad-460a-99da-0145ccd8ad44,remote_ip_prefix=,revision_number=0,security_group_id=b58146b2-0fad-460a-99da-0145ccd8ad44,updated_at=2022-09-04T01:06:30Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:30.719998 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-fbe26bad-f02d-46fa-be10-89a7e7b672f8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (734f5ef1-72b5-430b-bac8-4e198eff158c), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:30.720497 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-fbe26bad-f02d-46fa-be10-89a7e7b672f8 admin admin] Security group rule updated ['b58146b2-0fad-460a-99da-0145ccd8ad44'] Sep 04 01:06:30.721390 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-fbe26bad-f02d-46fa-be10-89a7e7b672f8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:30Z,description=,direction='egress',ethertype='IPv6',id=974d4d04-5321-463b-9099-7c8fc0311484,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2bea56a7089f4fa189405ee93b0993e5',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=b58146b2-0fad-460a-99da-0145ccd8ad44,updated_at=2022-09-04T01:06:30Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:30.721907 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-fbe26bad-f02d-46fa-be10-89a7e7b672f8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (974d4d04-5321-463b-9099-7c8fc0311484), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:30.723004 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-fbe26bad-f02d-46fa-be10-89a7e7b672f8 admin admin] Security group rule updated ['b58146b2-0fad-460a-99da-0145ccd8ad44'] Sep 04 01:06:30.723759 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-fbe26bad-f02d-46fa-be10-89a7e7b672f8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:30Z,description=,direction='ingress',ethertype='IPv6',id=aca7f00d-01cd-4d2f-9a04-c37beee8875f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2bea56a7089f4fa189405ee93b0993e5',protocol=,remote_address_group_id=,remote_group_id=b58146b2-0fad-460a-99da-0145ccd8ad44,remote_ip_prefix=,revision_number=0,security_group_id=b58146b2-0fad-460a-99da-0145ccd8ad44,updated_at=2022-09-04T01:06:30Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:30.724305 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-fbe26bad-f02d-46fa-be10-89a7e7b672f8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (aca7f00d-01cd-4d2f-9a04-c37beee8875f), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:30.724798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-fbe26bad-f02d-46fa-be10-89a7e7b672f8 admin admin] Security group rule updated ['b58146b2-0fad-460a-99da-0145ccd8ad44'] Sep 04 01:06:30.725531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-fbe26bad-f02d-46fa-be10-89a7e7b672f8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:30Z,description=,direction='egress',ethertype='IPv4',id=c450878c-5cc4-4939-9bf9-4c3ce1df7327,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2bea56a7089f4fa189405ee93b0993e5',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=b58146b2-0fad-460a-99da-0145ccd8ad44,updated_at=2022-09-04T01:06:30Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:30.725891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-fbe26bad-f02d-46fa-be10-89a7e7b672f8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (c450878c-5cc4-4939-9bf9-4c3ce1df7327), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:30.726218 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-fbe26bad-f02d-46fa-be10-89a7e7b672f8 admin admin] Security group rule updated ['b58146b2-0fad-460a-99da-0145ccd8ad44'] Sep 04 01:06:30.905318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-11265328-6178-4cac-8816-7b38ef2f0173 admin admin] Resource SecurityGroup deleted: 5d556b1a-abc6-4c4c-81f1-574f88cc44cb {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:30.905834 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-11265328-6178-4cac-8816-7b38ef2f0173 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (5d556b1a-abc6-4c4c-81f1-574f88cc44cb), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:30.906412 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11265328-6178-4cac-8816-7b38ef2f0173 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('5d556b1a-abc6-4c4c-81f1-574f88cc44cb',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:06:30.940540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-11265328-6178-4cac-8816-7b38ef2f0173 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('5d556b1a-abc6-4c4c-81f1-574f88cc44cb',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:06:30.942369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-11265328-6178-4cac-8816-7b38ef2f0173 admin admin] Resource SecurityGroupRule deleted: 0135a52d-f4fe-4ebd-9127-6fc075945947 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:30.944045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-11265328-6178-4cac-8816-7b38ef2f0173 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (0135a52d-f4fe-4ebd-9127-6fc075945947), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:30.944045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-11265328-6178-4cac-8816-7b38ef2f0173 admin admin] Security group rule updated ['5d556b1a-abc6-4c4c-81f1-574f88cc44cb'] Sep 04 01:06:30.945432 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-11265328-6178-4cac-8816-7b38ef2f0173 admin admin] Resource SecurityGroupRule deleted: 4b84ae99-a41a-42fa-9301-0321208e6fbb {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:30.945838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-11265328-6178-4cac-8816-7b38ef2f0173 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (4b84ae99-a41a-42fa-9301-0321208e6fbb), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:30.946179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-11265328-6178-4cac-8816-7b38ef2f0173 admin admin] Security group rule updated ['5d556b1a-abc6-4c4c-81f1-574f88cc44cb'] Sep 04 01:06:30.946639 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-11265328-6178-4cac-8816-7b38ef2f0173 admin admin] Resource SecurityGroupRule deleted: 4f710d84-a7b5-4252-9c6b-d442ebcfc4c3 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:30.946993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-11265328-6178-4cac-8816-7b38ef2f0173 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (4f710d84-a7b5-4252-9c6b-d442ebcfc4c3), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:30.947313 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-11265328-6178-4cac-8816-7b38ef2f0173 admin admin] Security group rule updated ['5d556b1a-abc6-4c4c-81f1-574f88cc44cb'] Sep 04 01:06:30.947725 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-11265328-6178-4cac-8816-7b38ef2f0173 admin admin] Resource SecurityGroupRule deleted: 4f91c951-de51-4fd3-80c3-03f652cf9f31 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:30.948064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-11265328-6178-4cac-8816-7b38ef2f0173 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (4f91c951-de51-4fd3-80c3-03f652cf9f31), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:30.948379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-11265328-6178-4cac-8816-7b38ef2f0173 admin admin] Security group rule updated ['5d556b1a-abc6-4c4c-81f1-574f88cc44cb'] Sep 04 01:06:31.071167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-2e5c5159-0de5-4ca5-955c-40180d38f0f1 admin admin] Resource SecurityGroup deleted: b58146b2-0fad-460a-99da-0145ccd8ad44 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:31.071616 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-2e5c5159-0de5-4ca5-955c-40180d38f0f1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (b58146b2-0fad-460a-99da-0145ccd8ad44), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:31.072186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e5c5159-0de5-4ca5-955c-40180d38f0f1 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('b58146b2-0fad-460a-99da-0145ccd8ad44',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:06:31.094782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-2e5c5159-0de5-4ca5-955c-40180d38f0f1 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('b58146b2-0fad-460a-99da-0145ccd8ad44',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:06:31.095593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-2e5c5159-0de5-4ca5-955c-40180d38f0f1 admin admin] Resource SecurityGroupRule deleted: 734f5ef1-72b5-430b-bac8-4e198eff158c {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:31.096236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-2e5c5159-0de5-4ca5-955c-40180d38f0f1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (734f5ef1-72b5-430b-bac8-4e198eff158c), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:31.096820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-2e5c5159-0de5-4ca5-955c-40180d38f0f1 admin admin] Security group rule updated ['b58146b2-0fad-460a-99da-0145ccd8ad44'] Sep 04 01:06:31.097648 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-2e5c5159-0de5-4ca5-955c-40180d38f0f1 admin admin] Resource SecurityGroupRule deleted: 974d4d04-5321-463b-9099-7c8fc0311484 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:31.098258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-2e5c5159-0de5-4ca5-955c-40180d38f0f1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (974d4d04-5321-463b-9099-7c8fc0311484), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:31.099175 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-2e5c5159-0de5-4ca5-955c-40180d38f0f1 admin admin] Security group rule updated ['b58146b2-0fad-460a-99da-0145ccd8ad44'] Sep 04 01:06:31.099801 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-2e5c5159-0de5-4ca5-955c-40180d38f0f1 admin admin] Resource SecurityGroupRule deleted: aca7f00d-01cd-4d2f-9a04-c37beee8875f {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:31.100605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-2e5c5159-0de5-4ca5-955c-40180d38f0f1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (aca7f00d-01cd-4d2f-9a04-c37beee8875f), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:31.101372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-2e5c5159-0de5-4ca5-955c-40180d38f0f1 admin admin] Security group rule updated ['b58146b2-0fad-460a-99da-0145ccd8ad44'] Sep 04 01:06:31.101986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-2e5c5159-0de5-4ca5-955c-40180d38f0f1 admin admin] Resource SecurityGroupRule deleted: c450878c-5cc4-4939-9bf9-4c3ce1df7327 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:31.102542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-2e5c5159-0de5-4ca5-955c-40180d38f0f1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (c450878c-5cc4-4939-9bf9-4c3ce1df7327), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:31.103206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-2e5c5159-0de5-4ca5-955c-40180d38f0f1 admin admin] Security group rule updated ['b58146b2-0fad-460a-99da-0145ccd8ad44'] Sep 04 01:06:31.465825 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Resource Port 0af19f52-43e4-40ca-848a-d2902c3e8205 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:06:31.466210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (0af19f52-43e4-40ca-848a-d2902c3e8205), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:31.887035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-2f60f4a0-5ae7-49f8-afd3-b0625c2d10df admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:06:31Z,description='Default security group',id=ea7c536d-3780-4d1c-85e1-f3232fe4b01e,is_default=True,name='default',project_id='55a945e6448f45deac4fbce8d4e5cdba',revision_number=1,rules=[SecurityGroupRule(1050acf5-f62a-4de3-b012-ddcecfedb0d1),SecurityGroupRule(35d70551-6c5b-41e9-938a-526f1f5adcf7),SecurityGroupRule(51a050bf-79b1-4e4a-8735-540035ebb894),SecurityGroupRule(c07b854f-6591-408a-8292-82a268d9960b)],shared=False,stateful=True,updated_at=2022-09-04T01:06:31Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:31.887658 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-2f60f4a0-5ae7-49f8-afd3-b0625c2d10df admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (ea7c536d-3780-4d1c-85e1-f3232fe4b01e), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:31.888079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-2f60f4a0-5ae7-49f8-afd3-b0625c2d10df admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:31Z,description=,direction='ingress',ethertype='IPv4',id=1050acf5-f62a-4de3-b012-ddcecfedb0d1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='55a945e6448f45deac4fbce8d4e5cdba',protocol=,remote_address_group_id=,remote_group_id=ea7c536d-3780-4d1c-85e1-f3232fe4b01e,remote_ip_prefix=,revision_number=0,security_group_id=ea7c536d-3780-4d1c-85e1-f3232fe4b01e,updated_at=2022-09-04T01:06:31Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:31.888502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-2f60f4a0-5ae7-49f8-afd3-b0625c2d10df admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (1050acf5-f62a-4de3-b012-ddcecfedb0d1), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:31.888863 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-2f60f4a0-5ae7-49f8-afd3-b0625c2d10df admin admin] Security group rule updated ['ea7c536d-3780-4d1c-85e1-f3232fe4b01e'] Sep 04 01:06:31.889627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-2f60f4a0-5ae7-49f8-afd3-b0625c2d10df admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:31Z,description=,direction='ingress',ethertype='IPv6',id=35d70551-6c5b-41e9-938a-526f1f5adcf7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='55a945e6448f45deac4fbce8d4e5cdba',protocol=,remote_address_group_id=,remote_group_id=ea7c536d-3780-4d1c-85e1-f3232fe4b01e,remote_ip_prefix=,revision_number=0,security_group_id=ea7c536d-3780-4d1c-85e1-f3232fe4b01e,updated_at=2022-09-04T01:06:31Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:31.889986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-2f60f4a0-5ae7-49f8-afd3-b0625c2d10df admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (35d70551-6c5b-41e9-938a-526f1f5adcf7), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:31.890322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-2f60f4a0-5ae7-49f8-afd3-b0625c2d10df admin admin] Security group rule updated ['ea7c536d-3780-4d1c-85e1-f3232fe4b01e'] Sep 04 01:06:31.891122 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-2f60f4a0-5ae7-49f8-afd3-b0625c2d10df admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:31Z,description=,direction='egress',ethertype='IPv6',id=51a050bf-79b1-4e4a-8735-540035ebb894,normalized_cidr=None,port_range_max=,port_range_min=,project_id='55a945e6448f45deac4fbce8d4e5cdba',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ea7c536d-3780-4d1c-85e1-f3232fe4b01e,updated_at=2022-09-04T01:06:31Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:31.891481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-2f60f4a0-5ae7-49f8-afd3-b0625c2d10df admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (51a050bf-79b1-4e4a-8735-540035ebb894), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:31.891810 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-2f60f4a0-5ae7-49f8-afd3-b0625c2d10df admin admin] Security group rule updated ['ea7c536d-3780-4d1c-85e1-f3232fe4b01e'] Sep 04 01:06:31.892517 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-2f60f4a0-5ae7-49f8-afd3-b0625c2d10df admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:31Z,description=,direction='egress',ethertype='IPv4',id=c07b854f-6591-408a-8292-82a268d9960b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='55a945e6448f45deac4fbce8d4e5cdba',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ea7c536d-3780-4d1c-85e1-f3232fe4b01e,updated_at=2022-09-04T01:06:31Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:31.892918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-2f60f4a0-5ae7-49f8-afd3-b0625c2d10df admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (c07b854f-6591-408a-8292-82a268d9960b), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:31.893307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-2f60f4a0-5ae7-49f8-afd3-b0625c2d10df admin admin] Security group rule updated ['ea7c536d-3780-4d1c-85e1-f3232fe4b01e'] Sep 04 01:06:32.117449 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-005b49db-25ea-440c-a846-6b265a138a75 admin admin] Resource SecurityGroup deleted: ea7c536d-3780-4d1c-85e1-f3232fe4b01e {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:32.118056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-005b49db-25ea-440c-a846-6b265a138a75 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (ea7c536d-3780-4d1c-85e1-f3232fe4b01e), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:32.120951 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-005b49db-25ea-440c-a846-6b265a138a75 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('ea7c536d-3780-4d1c-85e1-f3232fe4b01e',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:06:32.133335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-005b49db-25ea-440c-a846-6b265a138a75 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('ea7c536d-3780-4d1c-85e1-f3232fe4b01e',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:06:32.133849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-005b49db-25ea-440c-a846-6b265a138a75 admin admin] Resource SecurityGroupRule deleted: 1050acf5-f62a-4de3-b012-ddcecfedb0d1 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:32.134225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-005b49db-25ea-440c-a846-6b265a138a75 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (1050acf5-f62a-4de3-b012-ddcecfedb0d1), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:32.134565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-005b49db-25ea-440c-a846-6b265a138a75 admin admin] Security group rule updated ['ea7c536d-3780-4d1c-85e1-f3232fe4b01e'] Sep 04 01:06:32.135006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-005b49db-25ea-440c-a846-6b265a138a75 admin admin] Resource SecurityGroupRule deleted: 35d70551-6c5b-41e9-938a-526f1f5adcf7 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:32.135366 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-005b49db-25ea-440c-a846-6b265a138a75 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (35d70551-6c5b-41e9-938a-526f1f5adcf7), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:32.135695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-005b49db-25ea-440c-a846-6b265a138a75 admin admin] Security group rule updated ['ea7c536d-3780-4d1c-85e1-f3232fe4b01e'] Sep 04 01:06:32.136922 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-005b49db-25ea-440c-a846-6b265a138a75 admin admin] Resource SecurityGroupRule deleted: 51a050bf-79b1-4e4a-8735-540035ebb894 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:32.137341 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-005b49db-25ea-440c-a846-6b265a138a75 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (51a050bf-79b1-4e4a-8735-540035ebb894), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:32.138063 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-005b49db-25ea-440c-a846-6b265a138a75 admin admin] Security group rule updated ['ea7c536d-3780-4d1c-85e1-f3232fe4b01e'] Sep 04 01:06:32.138507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-005b49db-25ea-440c-a846-6b265a138a75 admin admin] Resource SecurityGroupRule deleted: c07b854f-6591-408a-8292-82a268d9960b {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:32.138859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-005b49db-25ea-440c-a846-6b265a138a75 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (c07b854f-6591-408a-8292-82a268d9960b), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:32.139183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-005b49db-25ea-440c-a846-6b265a138a75 admin admin] Security group rule updated ['ea7c536d-3780-4d1c-85e1-f3232fe4b01e'] Sep 04 01:06:32.242270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:291 started Sep 04 01:06:32.245435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade554d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=636000000,duration_sec=601,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:06:32.246763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:06:32.247307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:291 - starting polling. Elapsed:0.005 Sep 04 01:06:32.250167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:32.254429 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:291 - port information retrieved. Elapsed:0.012 Sep 04 01:06:32.254932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:291 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Sep 04 01:06:32.427218 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0b5a146f-fe0b-4fd1-979b-b51491e4fc13 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:06:32Z,description='Default security group',id=245b7b88-e26d-4774-a99b-34c84e379a3a,is_default=True,name='default',project_id='c968576dfbe64995bae40694095cb817',revision_number=1,rules=[SecurityGroupRule(1f835319-8692-4351-8d40-b16622214b54),SecurityGroupRule(b9705f45-8d8e-4acc-ab60-c5a4035adea5),SecurityGroupRule(d985a7cf-bf36-42b2-8da0-a20b14b854d5),SecurityGroupRule(edf9c8f5-c998-48e2-875a-055c4dfb0427)],shared=False,stateful=True,updated_at=2022-09-04T01:06:32Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:32.427704 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-0b5a146f-fe0b-4fd1-979b-b51491e4fc13 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (245b7b88-e26d-4774-a99b-34c84e379a3a), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:32.429158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0b5a146f-fe0b-4fd1-979b-b51491e4fc13 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:32Z,description=,direction='ingress',ethertype='IPv6',id=1f835319-8692-4351-8d40-b16622214b54,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c968576dfbe64995bae40694095cb817',protocol=,remote_address_group_id=,remote_group_id=245b7b88-e26d-4774-a99b-34c84e379a3a,remote_ip_prefix=,revision_number=0,security_group_id=245b7b88-e26d-4774-a99b-34c84e379a3a,updated_at=2022-09-04T01:06:32Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:32.429625 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-0b5a146f-fe0b-4fd1-979b-b51491e4fc13 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (1f835319-8692-4351-8d40-b16622214b54), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:32.430038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-0b5a146f-fe0b-4fd1-979b-b51491e4fc13 admin admin] Security group rule updated ['245b7b88-e26d-4774-a99b-34c84e379a3a'] Sep 04 01:06:32.431146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0b5a146f-fe0b-4fd1-979b-b51491e4fc13 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:32Z,description=,direction='egress',ethertype='IPv4',id=b9705f45-8d8e-4acc-ab60-c5a4035adea5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c968576dfbe64995bae40694095cb817',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=245b7b88-e26d-4774-a99b-34c84e379a3a,updated_at=2022-09-04T01:06:32Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:32.431611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-0b5a146f-fe0b-4fd1-979b-b51491e4fc13 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (b9705f45-8d8e-4acc-ab60-c5a4035adea5), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:32.432895 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-0b5a146f-fe0b-4fd1-979b-b51491e4fc13 admin admin] Security group rule updated ['245b7b88-e26d-4774-a99b-34c84e379a3a'] Sep 04 01:06:32.434366 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0b5a146f-fe0b-4fd1-979b-b51491e4fc13 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:32Z,description=,direction='ingress',ethertype='IPv4',id=d985a7cf-bf36-42b2-8da0-a20b14b854d5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c968576dfbe64995bae40694095cb817',protocol=,remote_address_group_id=,remote_group_id=245b7b88-e26d-4774-a99b-34c84e379a3a,remote_ip_prefix=,revision_number=0,security_group_id=245b7b88-e26d-4774-a99b-34c84e379a3a,updated_at=2022-09-04T01:06:32Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:32.434873 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-0b5a146f-fe0b-4fd1-979b-b51491e4fc13 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (d985a7cf-bf36-42b2-8da0-a20b14b854d5), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:32.435388 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-0b5a146f-fe0b-4fd1-979b-b51491e4fc13 admin admin] Security group rule updated ['245b7b88-e26d-4774-a99b-34c84e379a3a'] Sep 04 01:06:32.436098 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0b5a146f-fe0b-4fd1-979b-b51491e4fc13 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:32Z,description=,direction='egress',ethertype='IPv6',id=edf9c8f5-c998-48e2-875a-055c4dfb0427,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c968576dfbe64995bae40694095cb817',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=245b7b88-e26d-4774-a99b-34c84e379a3a,updated_at=2022-09-04T01:06:32Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:32.436612 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-0b5a146f-fe0b-4fd1-979b-b51491e4fc13 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (edf9c8f5-c998-48e2-875a-055c4dfb0427), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:32.436938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-0b5a146f-fe0b-4fd1-979b-b51491e4fc13 admin admin] Security group rule updated ['245b7b88-e26d-4774-a99b-34c84e379a3a'] Sep 04 01:06:32.679862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c7804ab4-be99-4e1a-a837-8d18eea115b2 admin admin] Resource SecurityGroup deleted: 245b7b88-e26d-4774-a99b-34c84e379a3a {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:32.680326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-c7804ab4-be99-4e1a-a837-8d18eea115b2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (245b7b88-e26d-4774-a99b-34c84e379a3a), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:32.681047 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7804ab4-be99-4e1a-a837-8d18eea115b2 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('245b7b88-e26d-4774-a99b-34c84e379a3a',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:06:32.698492 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c7804ab4-be99-4e1a-a837-8d18eea115b2 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('245b7b88-e26d-4774-a99b-34c84e379a3a',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:06:32.699115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c7804ab4-be99-4e1a-a837-8d18eea115b2 admin admin] Resource SecurityGroupRule deleted: 1f835319-8692-4351-8d40-b16622214b54 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:32.699551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-c7804ab4-be99-4e1a-a837-8d18eea115b2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (1f835319-8692-4351-8d40-b16622214b54), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:32.700288 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-c7804ab4-be99-4e1a-a837-8d18eea115b2 admin admin] Security group rule updated ['245b7b88-e26d-4774-a99b-34c84e379a3a'] Sep 04 01:06:32.700786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c7804ab4-be99-4e1a-a837-8d18eea115b2 admin admin] Resource SecurityGroupRule deleted: b9705f45-8d8e-4acc-ab60-c5a4035adea5 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:32.701213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-c7804ab4-be99-4e1a-a837-8d18eea115b2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (b9705f45-8d8e-4acc-ab60-c5a4035adea5), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:32.701621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-c7804ab4-be99-4e1a-a837-8d18eea115b2 admin admin] Security group rule updated ['245b7b88-e26d-4774-a99b-34c84e379a3a'] Sep 04 01:06:32.702159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c7804ab4-be99-4e1a-a837-8d18eea115b2 admin admin] Resource SecurityGroupRule deleted: d985a7cf-bf36-42b2-8da0-a20b14b854d5 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:32.702559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-c7804ab4-be99-4e1a-a837-8d18eea115b2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (d985a7cf-bf36-42b2-8da0-a20b14b854d5), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:32.702933 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-c7804ab4-be99-4e1a-a837-8d18eea115b2 admin admin] Security group rule updated ['245b7b88-e26d-4774-a99b-34c84e379a3a'] Sep 04 01:06:32.703447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c7804ab4-be99-4e1a-a837-8d18eea115b2 admin admin] Resource SecurityGroupRule deleted: edf9c8f5-c998-48e2-875a-055c4dfb0427 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:32.703839 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-c7804ab4-be99-4e1a-a837-8d18eea115b2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (edf9c8f5-c998-48e2-875a-055c4dfb0427), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:32.704344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-c7804ab4-be99-4e1a-a837-8d18eea115b2 admin admin] Security group rule updated ['245b7b88-e26d-4774-a99b-34c84e379a3a'] Sep 04 01:06:33.884269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c4c530cd-8534-4342-9b04-dcca7184768a admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:06:33Z,description='Default security group',id=dd251723-c6f9-4e67-b522-e38b91c2bfeb,is_default=True,name='default',project_id='6071c3a795ba4aa098e3af8cde306d58',revision_number=1,rules=[SecurityGroupRule(0ab4d151-33b1-4937-ae4d-6d1a414b66b4),SecurityGroupRule(5f784496-788e-4942-a57b-f0e3acc22c85),SecurityGroupRule(e8630b35-2e93-409a-9b8d-749cc25f02b9),SecurityGroupRule(fd742f91-3526-4a99-b715-3c944dfde89f)],shared=False,stateful=True,updated_at=2022-09-04T01:06:33Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:33.886001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-c4c530cd-8534-4342-9b04-dcca7184768a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (dd251723-c6f9-4e67-b522-e38b91c2bfeb), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:33.886961 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c4c530cd-8534-4342-9b04-dcca7184768a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:33Z,description=,direction='egress',ethertype='IPv4',id=0ab4d151-33b1-4937-ae4d-6d1a414b66b4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='6071c3a795ba4aa098e3af8cde306d58',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=dd251723-c6f9-4e67-b522-e38b91c2bfeb,updated_at=2022-09-04T01:06:33Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:33.887523 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-c4c530cd-8534-4342-9b04-dcca7184768a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (0ab4d151-33b1-4937-ae4d-6d1a414b66b4), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:33.888330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-c4c530cd-8534-4342-9b04-dcca7184768a admin admin] Security group rule updated ['dd251723-c6f9-4e67-b522-e38b91c2bfeb'] Sep 04 01:06:33.889467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c4c530cd-8534-4342-9b04-dcca7184768a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:33Z,description=,direction='ingress',ethertype='IPv6',id=5f784496-788e-4942-a57b-f0e3acc22c85,normalized_cidr=None,port_range_max=,port_range_min=,project_id='6071c3a795ba4aa098e3af8cde306d58',protocol=,remote_address_group_id=,remote_group_id=dd251723-c6f9-4e67-b522-e38b91c2bfeb,remote_ip_prefix=,revision_number=0,security_group_id=dd251723-c6f9-4e67-b522-e38b91c2bfeb,updated_at=2022-09-04T01:06:33Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:33.890041 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-c4c530cd-8534-4342-9b04-dcca7184768a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (5f784496-788e-4942-a57b-f0e3acc22c85), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:33.890733 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-c4c530cd-8534-4342-9b04-dcca7184768a admin admin] Security group rule updated ['dd251723-c6f9-4e67-b522-e38b91c2bfeb'] Sep 04 01:06:33.893367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c4c530cd-8534-4342-9b04-dcca7184768a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:33Z,description=,direction='ingress',ethertype='IPv4',id=e8630b35-2e93-409a-9b8d-749cc25f02b9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='6071c3a795ba4aa098e3af8cde306d58',protocol=,remote_address_group_id=,remote_group_id=dd251723-c6f9-4e67-b522-e38b91c2bfeb,remote_ip_prefix=,revision_number=0,security_group_id=dd251723-c6f9-4e67-b522-e38b91c2bfeb,updated_at=2022-09-04T01:06:33Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:33.893367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-c4c530cd-8534-4342-9b04-dcca7184768a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (e8630b35-2e93-409a-9b8d-749cc25f02b9), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:33.894965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-c4c530cd-8534-4342-9b04-dcca7184768a admin admin] Security group rule updated ['dd251723-c6f9-4e67-b522-e38b91c2bfeb'] Sep 04 01:06:33.895928 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c4c530cd-8534-4342-9b04-dcca7184768a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:33Z,description=,direction='egress',ethertype='IPv6',id=fd742f91-3526-4a99-b715-3c944dfde89f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='6071c3a795ba4aa098e3af8cde306d58',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=dd251723-c6f9-4e67-b522-e38b91c2bfeb,updated_at=2022-09-04T01:06:33Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:33.899222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-c4c530cd-8534-4342-9b04-dcca7184768a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (fd742f91-3526-4a99-b715-3c944dfde89f), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:33.899222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-c4c530cd-8534-4342-9b04-dcca7184768a admin admin] Security group rule updated ['dd251723-c6f9-4e67-b522-e38b91c2bfeb'] Sep 04 01:06:34.097473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c4c530cd-8534-4342-9b04-dcca7184768a admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-04T01:06:33Z,description='',dns_domain=None,id=f5f50aa9-3a0d-4b0d-aee8-3b2aef89717d,mtu=1500,name='tempest-VolumesSnapshotTestJSON-773316415-network',project_id='6071c3a795ba4aa098e3af8cde306d58',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(f5f50aa9-3a0d-4b0d-aee8-3b2aef89717d),segments=[NetworkSegment(691a306c-3c07-49ca-8d5b-c7e7a9ad5919)],shared=False,status='ACTIVE',updated_at=2022-09-04T01:06:33Z,vlan_transparent=) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:34.098500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-c4c530cd-8534-4342-9b04-dcca7184768a admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533'] for Network (f5f50aa9-3a0d-4b0d-aee8-3b2aef89717d), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:34.119143 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-75f29801-a8f1-465b-b2b5-673c09f019e2 admin admin] Resource Port deleted: a62a40a2-96f5-427a-808e-9e63c8644245 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:34.119691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-75f29801-a8f1-465b-b2b5-673c09f019e2 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (a62a40a2-96f5-427a-808e-9e63c8644245), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:34.237307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager [None req-c4c530cd-8534-4342-9b04-dcca7184768a admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network f5f50aa9-3a0d-4b0d-aee8-3b2aef89717d with segmentation id not found. Sep 04 01:06:34.237307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 04 01:06:34.237307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 04 01:06:34.237307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 04 01:06:34.237307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 04 01:06:34.237307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 04 01:06:34.237307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 04 01:06:34.237307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 04 01:06:34.237307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 04 01:06:34.237307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 04 01:06:34.237307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 04 01:06:34.237307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 04 01:06:34.237307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 04 01:06:34.246805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 04 01:06:34.246805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 04 01:06:34.246805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 04 01:06:34.246805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network f5f50aa9-3a0d-4b0d-aee8-3b2aef89717d with segmentation id not found. Sep 04 01:06:34.246805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager Sep 04 01:06:34.246805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:292 started Sep 04 01:06:34.250322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade554f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=641000000,duration_sec=603,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:06:34.250919 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:06:34.251257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:292 - starting polling. Elapsed:0.008 Sep 04 01:06:34.255106 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:34.259681 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-a62a40a2-96, col_values=(('tag', 4095),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:06:34.272612 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade5551,OFPFlowMod(buffer_id=4294967295,command=0,cookie=6887031442322345889,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 13}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:06:34.273548 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for ['a62a40a2-96f5-427a-808e-9e63c8644245'] Sep 04 01:06:34.274209 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 4 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:06:34.321706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd2f9a2-b878-44e7-9173-9e4900548c04]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:06:34.326585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:292 - port information retrieved. Elapsed:0.084 Sep 04 01:06:34.326933 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:292 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.084 Sep 04 01:06:34.849796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-e7937cca-4bc2-4d8d-9613-0dc296a28b3d admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(27cc01c6-23f2-4e67-bead-21baedb5c126)],cidr=172.20.0.0/28,created_at=2022-09-04T01:06:34Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=False,gateway_ip=172.20.0.1,host_routes=[],id=69d55e63-fdcb-4ee5-a9f8-cb02b9c67f96,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-VolumesSnapshotTestJSON-773316415-subnet',network_id=f5f50aa9-3a0d-4b0d-aee8-3b2aef89717d,project_id='6071c3a795ba4aa098e3af8cde306d58',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-04T01:06:34Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:34.850174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-e7937cca-4bc2-4d8d-9613-0dc296a28b3d admin admin] Publish callbacks [] for Subnet (69d55e63-fdcb-4ee5-a9f8-cb02b9c67f96), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:35.442373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["c00bf884-564b-46cb-8db2-bbfc97020010","delete","qr-a62a40a2-96",13,["map",[["attached-mac","fa:16:3e:dd:cb:78"],["iface-id","a62a40a2-96f5-427a-808e-9e63c8644245"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:06:35.827264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-e9a1ae6b-16e0-4147-bc41-dcd9c3b5872e admin admin] Resource Port deleted: 3c278ab2-dc61-40f8-ab29-c8cc8b740d7d {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:35.828207 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-e9a1ae6b-16e0-4147-bc41-dcd9c3b5872e admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (3c278ab2-dc61-40f8-ab29-c8cc8b740d7d), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:36.246447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:293 started Sep 04 01:06:36.251704 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5553,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=641000000,duration_sec=605,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:06:36.252906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:06:36.258603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:293 - starting polling. Elapsed:0.012 Sep 04 01:06:36.261966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:36.267225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-3c278ab2-dc, col_values=(('tag', 4095),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:06:36.291911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade5555,OFPFlowMod(buffer_id=4294967295,command=0,cookie=6887031442322345889,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 8}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:06:36.292383 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for ['3c278ab2-dc61-40f8-ab29-c8cc8b740d7d'] Sep 04 01:06:36.293224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 4 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:06:36.345723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c479e3f-804c-40f1-bd11-6add7872c5c6]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:06:36.354449 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade5557,OFPFlowMod(buffer_id=4294967295,command=3,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 13}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:06:36.355112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:293 - port information retrieved. Elapsed:0.109 Sep 04 01:06:36.355666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Starting to process devices in:{'current': {'9b82da41-d694-43b0-a43b-5998addaf0bf', '3c278ab2-dc61-40f8-ab29-c8cc8b740d7d', 'c2f724af-5dbd-4d91-83cd-c5152b744599', 'a6788698-0516-4d8a-8fe8-2add6e7f6e94', 'f38c3884-111a-49d9-bcf1-6a965ff5e110', '3fa24970-97a7-4f46-ac55-0b24323fa402', '0a1a9f7e-73de-4620-ae03-4b1d50d7f706', '3045b911-01c5-4fc3-8e89-ac2d9cea12a8', '89aa06b4-bbf1-40c2-bb48-500c3aecdf48', '6771cbc4-3e4b-419f-b87f-2db662f6e010', '4ed942cd-0f45-4d77-a66d-1d6c875877dc', 'f45b435f-0f64-41fe-a6ec-36683da765f9', '53e7a39c-e9ce-45c4-84af-632f2aac70ae', '378bbdd4-3077-4657-8055-fdc0a7600948', '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', 'dd44c60a-dd0f-4ff2-85ae-8c012af89cf9', '1cf499fb-10a0-4af2-afec-5f610dc85da6', 'ca102ce7-433c-4029-aabf-33d944165ff1'}, 'added': set(), 'removed': {'a62a40a2-96f5-427a-808e-9e63c8644245'}, 'updated': set(), 're_added': set()} {{(pid=107812) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 04 01:06:36.356234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:293 - agent port security group processed in 0.000 Sep 04 01:06:36.377849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Configuration for devices up [] and devices down [] completed. Sep 04 01:06:36.378982 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for {'a62a40a2-96f5-427a-808e-9e63c8644245'} Sep 04 01:06:36.379379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port a62a40a2-96f5-427a-808e-9e63c8644245 is not handled by the firewall. {{(pid=107812) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 04 01:06:36.379685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Ports {'a62a40a2-96f5-427a-808e-9e63c8644245'} removed Sep 04 01:06:36.407852 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["925a7810-ba2c-4bdf-b62c-4d19a454d6cd","delete","qg-3c278ab2-dc",8,["map",[["attached-mac","fa:16:3e:92:fb:aa"],["iface-id","3c278ab2-dc61-40f8-ab29-c8cc8b740d7d"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:06:36.413310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port removal failed for set() {{(pid=107812) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 04 01:06:36.413678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] net_uuid None not managed by VLAN manager Sep 04 01:06:36.414151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:293 - treat_devices_removed completed in 0.036 Sep 04 01:06:36.414442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:293 - ports processed. Elapsed:0.168 Sep 04 01:06:36.414842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:293 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 1}}. Elapsed:0.169 Sep 04 01:06:36.598132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-7836b3c3-5a8e-4ef5-badd-92b7bef4c099 admin admin] Resource Subnet deleted: 46f76b48-bc1e-4bf9-b91c-49408437f259 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:36.598757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-7836b3c3-5a8e-4ef5-badd-92b7bef4c099 admin admin] Publish callbacks [] for Subnet (46f76b48-bc1e-4bf9-b91c-49408437f259), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:36.767398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["a90a2884-b490-42e0-ac4b-e206ce63e14f","delete","tap9b82da41-d6",6,["map",[["attached-mac","fa:16:3e:3b:22:50"],["iface-id","9b82da41-d694-43b0-a43b-5998addaf0bf"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:06:37.276875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b01460f8-da7a-4e80-aa21-096638112e89 None None] Resource Port deleted: 9b82da41-d694-43b0-a43b-5998addaf0bf {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:37.277352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b01460f8-da7a-4e80-aa21-096638112e89 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (9b82da41-d694-43b0-a43b-5998addaf0bf), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:37.285479 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-2363ca2a-1641-4d23-9187-719b69c3c6fb admin admin] Resource Port deleted: 9b82da41-d694-43b0-a43b-5998addaf0bf {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:37.285881 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-2363ca2a-1641-4d23-9187-719b69c3c6fb admin admin] Skipped duplicate delete event for 9b82da41-d694-43b0-a43b-5998addaf0bf {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:209}} Sep 04 01:06:37.930103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-2363ca2a-1641-4d23-9187-719b69c3c6fb admin admin] Resource Network deleted: 3b7528ba-1624-4915-b635-aeb0700ea8e7 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:37.931495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-2363ca2a-1641-4d23-9187-719b69c3c6fb admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533'] for Network (3b7528ba-1624-4915-b635-aeb0700ea8e7), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:38.105678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-004bb7f9-e421-4a13-b5c1-21cd7701d770 tempest-VolumesNegativeTest-1515737641 tempest-VolumesNegativeTest-1515737641-project] Resource Port deleted: 0af19f52-43e4-40ca-848a-d2902c3e8205 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:38.105678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-004bb7f9-e421-4a13-b5c1-21cd7701d770 tempest-VolumesNegativeTest-1515737641 tempest-VolumesNegativeTest-1515737641-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (0af19f52-43e4-40ca-848a-d2902c3e8205), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:38.105966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-004bb7f9-e421-4a13-b5c1-21cd7701d770 tempest-VolumesNegativeTest-1515737641 tempest-VolumesNegativeTest-1515737641-project] Security group member updated {'895e5321-ec4e-448d-8f9a-e84e7b053e04'} Sep 04 01:06:38.247438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:294 started Sep 04 01:06:38.249994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5559,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=642000000,duration_sec=607,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:06:38.250628 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:06:38.251082 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:294 - starting polling. Elapsed:0.004 Sep 04 01:06:38.254451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:38.256357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 0af19f52-43e4-40ca-848a-d2902c3e8205 not present in bridge br-int Sep 04 01:06:38.256885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] net_uuid None not managed by VLAN manager Sep 04 01:06:38.257392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for ['0af19f52-43e4-40ca-848a-d2902c3e8205'] Sep 04 01:06:38.257865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 0af19f52-43e4-40ca-848a-d2902c3e8205 is not handled by the firewall. {{(pid=107812) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 04 01:06:38.264355 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade555b,OFPFlowMod(buffer_id=4294967295,command=3,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 8}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:06:38.268513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade555d,OFPFlowMod(buffer_id=4294967295,command=3,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 6}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:06:38.268513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:294 - port information retrieved. Elapsed:0.020 Sep 04 01:06:38.268762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Starting to process devices in:{'current': {'c2f724af-5dbd-4d91-83cd-c5152b744599', 'a6788698-0516-4d8a-8fe8-2add6e7f6e94', 'f38c3884-111a-49d9-bcf1-6a965ff5e110', '3fa24970-97a7-4f46-ac55-0b24323fa402', '0a1a9f7e-73de-4620-ae03-4b1d50d7f706', '3045b911-01c5-4fc3-8e89-ac2d9cea12a8', '89aa06b4-bbf1-40c2-bb48-500c3aecdf48', '6771cbc4-3e4b-419f-b87f-2db662f6e010', '4ed942cd-0f45-4d77-a66d-1d6c875877dc', 'f45b435f-0f64-41fe-a6ec-36683da765f9', '53e7a39c-e9ce-45c4-84af-632f2aac70ae', '378bbdd4-3077-4657-8055-fdc0a7600948', '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', 'dd44c60a-dd0f-4ff2-85ae-8c012af89cf9', '1cf499fb-10a0-4af2-afec-5f610dc85da6', 'ca102ce7-433c-4029-aabf-33d944165ff1'}, 'added': set(), 'removed': {'3c278ab2-dc61-40f8-ab29-c8cc8b740d7d', '9b82da41-d694-43b0-a43b-5998addaf0bf'}, 'updated': set(), 're_added': set()} {{(pid=107812) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 04 01:06:38.268762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:294 - agent port security group processed in 0.000 Sep 04 01:06:38.270984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Configuration for devices up [] and devices down [] completed. Sep 04 01:06:38.271291 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for {'3c278ab2-dc61-40f8-ab29-c8cc8b740d7d', '9b82da41-d694-43b0-a43b-5998addaf0bf'} Sep 04 01:06:38.271620 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 3c278ab2-dc61-40f8-ab29-c8cc8b740d7d is not handled by the firewall. {{(pid=107812) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 04 01:06:38.272106 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 4 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:06:38.326021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[5187ff8a-780a-44fe-a1bc-b9d06423649e]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:06:38.326668 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Ports {'3c278ab2-dc61-40f8-ab29-c8cc8b740d7d', '9b82da41-d694-43b0-a43b-5998addaf0bf'} removed Sep 04 01:06:38.395620 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port removal failed for set() {{(pid=107812) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 04 01:06:38.396201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] net_uuid None not managed by VLAN manager Sep 04 01:06:38.396927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Reclaiming vlan = 4 from net-id = 3b7528ba-1624-4915-b635-aeb0700ea8e7, seg-id = 158 Sep 04 01:06:38.399859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x1fd38bfd,OFPFlowMod(buffer_id=4294967295,command=3,cookie=6561907047025962751,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4100}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:06:38.403336 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xeade555f,OFPFlowMod(buffer_id=4294967295,command=3,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4254}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:06:38.403786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:294 - treat_devices_removed completed in 0.132 Sep 04 01:06:38.404191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:294 - ports processed. Elapsed:0.157 Sep 04 01:06:38.404576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:294 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 2}}. Elapsed:0.157 Sep 04 01:06:38.836361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-d2a0a28d-5373-4bc0-8341-d431c7a7aa9a admin admin] Resource SecurityGroup deleted: 703cb105-947c-42c1-9237-d9f950459033 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:38.837223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-d2a0a28d-5373-4bc0-8341-d431c7a7aa9a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (703cb105-947c-42c1-9237-d9f950459033), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:38.837803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2a0a28d-5373-4bc0-8341-d431c7a7aa9a admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('703cb105-947c-42c1-9237-d9f950459033',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:06:38.856112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-d2a0a28d-5373-4bc0-8341-d431c7a7aa9a admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('703cb105-947c-42c1-9237-d9f950459033',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:06:38.858029 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-d2a0a28d-5373-4bc0-8341-d431c7a7aa9a admin admin] Resource SecurityGroupRule deleted: a55baf54-5af8-4373-b79a-d07ce8879a79 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:38.859054 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-d2a0a28d-5373-4bc0-8341-d431c7a7aa9a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (a55baf54-5af8-4373-b79a-d07ce8879a79), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:38.859404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-d2a0a28d-5373-4bc0-8341-d431c7a7aa9a admin admin] Security group rule updated ['703cb105-947c-42c1-9237-d9f950459033'] Sep 04 01:06:38.859993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-d2a0a28d-5373-4bc0-8341-d431c7a7aa9a admin admin] Resource SecurityGroupRule deleted: a9939108-1070-47c5-9724-561e7cc9ce6b {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:38.860777 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-d2a0a28d-5373-4bc0-8341-d431c7a7aa9a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (a9939108-1070-47c5-9724-561e7cc9ce6b), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:38.861526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-d2a0a28d-5373-4bc0-8341-d431c7a7aa9a admin admin] Security group rule updated ['703cb105-947c-42c1-9237-d9f950459033'] Sep 04 01:06:38.862665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-d2a0a28d-5373-4bc0-8341-d431c7a7aa9a admin admin] Resource SecurityGroupRule deleted: ce5cf9ce-37b8-4203-ae7c-f4d4d55d355b {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:38.863049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-d2a0a28d-5373-4bc0-8341-d431c7a7aa9a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (ce5cf9ce-37b8-4203-ae7c-f4d4d55d355b), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:38.863382 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-d2a0a28d-5373-4bc0-8341-d431c7a7aa9a admin admin] Security group rule updated ['703cb105-947c-42c1-9237-d9f950459033'] Sep 04 01:06:38.864037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-d2a0a28d-5373-4bc0-8341-d431c7a7aa9a admin admin] Resource SecurityGroupRule deleted: e8a5e408-0f0d-442c-8e96-705ce85a7ab3 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:38.864628 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-d2a0a28d-5373-4bc0-8341-d431c7a7aa9a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (e8a5e408-0f0d-442c-8e96-705ce85a7ab3), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:38.865125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-d2a0a28d-5373-4bc0-8341-d431c7a7aa9a admin admin] Security group rule updated ['703cb105-947c-42c1-9237-d9f950459033'] Sep 04 01:06:40.248912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:295 started Sep 04 01:06:40.252078 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5561,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=643000000,duration_sec=609,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:06:40.253896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:06:40.254259 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:295 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 04 01:06:42.208540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-3d4985e6-7ee9-4d6a-90d6-74fd85253119 tempest-VolumesSnapshotTestJSON-1378097567 tempest-VolumesSnapshotTestJSON-1378097567-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:06:41Z,data_plane_status=None,description='',device_id='2808d334-c39c-4a09-88c7-c1711cce4215',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=449add0b-213e-49af-b0f2-5656f19d796f,mac_address=fa:16:3e:8b:03:e2,name='',network_id=f5f50aa9-3a0d-4b0d-aee8-3b2aef89717d,numa_affinity_policy=,project_id='6071c3a795ba4aa098e3af8cde306d58',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(449add0b-213e-49af-b0f2-5656f19d796f),security_group_ids=set([dd251723-c6f9-4e67-b522-e38b91c2bfeb]),status='DOWN',updated_at=2022-09-04T01:06:41Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:42.209210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-3d4985e6-7ee9-4d6a-90d6-74fd85253119 tempest-VolumesSnapshotTestJSON-1378097567 tempest-VolumesSnapshotTestJSON-1378097567-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (449add0b-213e-49af-b0f2-5656f19d796f), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:42.209622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-3d4985e6-7ee9-4d6a-90d6-74fd85253119 tempest-VolumesSnapshotTestJSON-1378097567 tempest-VolumesSnapshotTestJSON-1378097567-project] Security group member updated {'dd251723-c6f9-4e67-b522-e38b91c2bfeb'} Sep 04 01:06:42.250403 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:296 started Sep 04 01:06:42.252946 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5563,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=644000000,duration_sec=611,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:06:42.253702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:06:42.254038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:296 - starting polling. Elapsed:0.004 Sep 04 01:06:42.256782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:42.259944 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:296 - port information retrieved. Elapsed:0.010 Sep 04 01:06:42.260346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:296 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Sep 04 01:06:42.892364 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-5d9308eb-8493-4f54-a4d7-6e823db22545 service neutron] Resource Port 449add0b-213e-49af-b0f2-5656f19d796f updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=449add0b-213e-49af-b0f2-5656f19d796f,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=449add0b-213e-49af-b0f2-5656f19d796f,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:06:42.892748 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-5d9308eb-8493-4f54-a4d7-6e823db22545 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (449add0b-213e-49af-b0f2-5656f19d796f), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:43.136439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-5d9308eb-8493-4f54-a4d7-6e823db22545 service neutron] Resource Port 449add0b-213e-49af-b0f2-5656f19d796f updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=449add0b-213e-49af-b0f2-5656f19d796f,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=449add0b-213e-49af-b0f2-5656f19d796f,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=449add0b-213e-49af-b0f2-5656f19d796f,segment=NetworkSegment(691a306c-3c07-49ca-8d5b-c7e7a9ad5919),segment_id=691a306c-3c07-49ca-8d5b-c7e7a9ad5919)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:06:43.137669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-5d9308eb-8493-4f54-a4d7-6e823db22545 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (449add0b-213e-49af-b0f2-5656f19d796f), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:44.251916 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:297 started Sep 04 01:06:44.255222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5565,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=647000000,duration_sec=613,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:06:44.255884 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:06:44.256188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:297 - starting polling. Elapsed:0.004 Sep 04 01:06:44.258594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:44.261722 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:297 - port information retrieved. Elapsed:0.010 Sep 04 01:06:44.262048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:297 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Sep 04 01:06:46.253249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:298 started Sep 04 01:06:46.258205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5567,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=647000000,duration_sec=615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:06:46.258205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:06:46.258205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:298 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:06:48.253675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:299 started Sep 04 01:06:48.256549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5569,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=648000000,duration_sec=617,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:06:48.257148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:06:48.257502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:299 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:06:48.442906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4fb5e5f9-ed70-428f-8f6b-945b8174a0ec admin admin] Resource SecurityGroup deleted: 895e5321-ec4e-448d-8f9a-e84e7b053e04 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:48.443362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4fb5e5f9-ed70-428f-8f6b-945b8174a0ec admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (895e5321-ec4e-448d-8f9a-e84e7b053e04), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:48.443951 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4fb5e5f9-ed70-428f-8f6b-945b8174a0ec admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('895e5321-ec4e-448d-8f9a-e84e7b053e04',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:06:48.457934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4fb5e5f9-ed70-428f-8f6b-945b8174a0ec admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('895e5321-ec4e-448d-8f9a-e84e7b053e04',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:06:48.458769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4fb5e5f9-ed70-428f-8f6b-945b8174a0ec admin admin] Resource SecurityGroupRule deleted: 1c1de0d9-ca04-45cd-8434-bdc8078e1884 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:48.459328 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4fb5e5f9-ed70-428f-8f6b-945b8174a0ec admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (1c1de0d9-ca04-45cd-8434-bdc8078e1884), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:48.459917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-4fb5e5f9-ed70-428f-8f6b-945b8174a0ec admin admin] Security group rule updated ['895e5321-ec4e-448d-8f9a-e84e7b053e04'] Sep 04 01:06:48.460612 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4fb5e5f9-ed70-428f-8f6b-945b8174a0ec admin admin] Resource SecurityGroupRule deleted: 3b987559-2c9c-4021-bdf4-a1b6ec577b26 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:48.461231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4fb5e5f9-ed70-428f-8f6b-945b8174a0ec admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (3b987559-2c9c-4021-bdf4-a1b6ec577b26), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:48.461662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-4fb5e5f9-ed70-428f-8f6b-945b8174a0ec admin admin] Security group rule updated ['895e5321-ec4e-448d-8f9a-e84e7b053e04'] Sep 04 01:06:48.462238 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4fb5e5f9-ed70-428f-8f6b-945b8174a0ec admin admin] Resource SecurityGroupRule deleted: dd4c02d5-2845-4a8a-ab0e-3b053caa4d01 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:48.462647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4fb5e5f9-ed70-428f-8f6b-945b8174a0ec admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (dd4c02d5-2845-4a8a-ab0e-3b053caa4d01), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:48.463028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-4fb5e5f9-ed70-428f-8f6b-945b8174a0ec admin admin] Security group rule updated ['895e5321-ec4e-448d-8f9a-e84e7b053e04'] Sep 04 01:06:48.463660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4fb5e5f9-ed70-428f-8f6b-945b8174a0ec admin admin] Resource SecurityGroupRule deleted: f5de877b-4d14-4781-8065-a8d13dd99d3e {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:48.464233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4fb5e5f9-ed70-428f-8f6b-945b8174a0ec admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (f5de877b-4d14-4781-8065-a8d13dd99d3e), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:48.464668 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-4fb5e5f9-ed70-428f-8f6b-945b8174a0ec admin admin] Security group rule updated ['895e5321-ec4e-448d-8f9a-e84e7b053e04'] Sep 04 01:06:50.254665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:300 started Sep 04 01:06:50.258258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade556b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=649000000,duration_sec=619,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:06:50.259021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:06:50.259401 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:300 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 04 01:06:50.392923 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-f5740dd5-abe0-46de-9e40-85e86866d818 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:06:50Z,description='Default security group',id=6ca79921-cac2-48b6-b2fd-5f8c56bead65,is_default=True,name='default',project_id='07a7237c4f0c4f3e8e43aa14ec0a9064',revision_number=1,rules=[SecurityGroupRule(119411cd-85b5-4879-a299-2bc992b51cbe),SecurityGroupRule(5438bfa3-fd93-4107-a703-f72f9977d29d),SecurityGroupRule(b7c72b8a-17ee-4d8b-ae0c-90cb8bbee69b),SecurityGroupRule(f75a9252-cb76-4ba1-beb9-387f2cc787ca)],shared=False,stateful=True,updated_at=2022-09-04T01:06:50Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:50.393329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-f5740dd5-abe0-46de-9e40-85e86866d818 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (6ca79921-cac2-48b6-b2fd-5f8c56bead65), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:50.393957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-f5740dd5-abe0-46de-9e40-85e86866d818 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:50Z,description=,direction='egress',ethertype='IPv4',id=119411cd-85b5-4879-a299-2bc992b51cbe,normalized_cidr=None,port_range_max=,port_range_min=,project_id='07a7237c4f0c4f3e8e43aa14ec0a9064',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=6ca79921-cac2-48b6-b2fd-5f8c56bead65,updated_at=2022-09-04T01:06:50Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:50.394315 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-f5740dd5-abe0-46de-9e40-85e86866d818 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (119411cd-85b5-4879-a299-2bc992b51cbe), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:50.394647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-f5740dd5-abe0-46de-9e40-85e86866d818 admin admin] Security group rule updated ['6ca79921-cac2-48b6-b2fd-5f8c56bead65'] Sep 04 01:06:50.395361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-f5740dd5-abe0-46de-9e40-85e86866d818 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:50Z,description=,direction='ingress',ethertype='IPv6',id=5438bfa3-fd93-4107-a703-f72f9977d29d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='07a7237c4f0c4f3e8e43aa14ec0a9064',protocol=,remote_address_group_id=,remote_group_id=6ca79921-cac2-48b6-b2fd-5f8c56bead65,remote_ip_prefix=,revision_number=0,security_group_id=6ca79921-cac2-48b6-b2fd-5f8c56bead65,updated_at=2022-09-04T01:06:50Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:50.395712 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-f5740dd5-abe0-46de-9e40-85e86866d818 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (5438bfa3-fd93-4107-a703-f72f9977d29d), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:50.396036 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-f5740dd5-abe0-46de-9e40-85e86866d818 admin admin] Security group rule updated ['6ca79921-cac2-48b6-b2fd-5f8c56bead65'] Sep 04 01:06:50.396722 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-f5740dd5-abe0-46de-9e40-85e86866d818 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:50Z,description=,direction='egress',ethertype='IPv6',id=b7c72b8a-17ee-4d8b-ae0c-90cb8bbee69b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='07a7237c4f0c4f3e8e43aa14ec0a9064',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=6ca79921-cac2-48b6-b2fd-5f8c56bead65,updated_at=2022-09-04T01:06:50Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:50.397068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-f5740dd5-abe0-46de-9e40-85e86866d818 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (b7c72b8a-17ee-4d8b-ae0c-90cb8bbee69b), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:50.397414 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-f5740dd5-abe0-46de-9e40-85e86866d818 admin admin] Security group rule updated ['6ca79921-cac2-48b6-b2fd-5f8c56bead65'] Sep 04 01:06:50.398157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-f5740dd5-abe0-46de-9e40-85e86866d818 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:06:50Z,description=,direction='ingress',ethertype='IPv4',id=f75a9252-cb76-4ba1-beb9-387f2cc787ca,normalized_cidr=None,port_range_max=,port_range_min=,project_id='07a7237c4f0c4f3e8e43aa14ec0a9064',protocol=,remote_address_group_id=,remote_group_id=6ca79921-cac2-48b6-b2fd-5f8c56bead65,remote_ip_prefix=,revision_number=0,security_group_id=6ca79921-cac2-48b6-b2fd-5f8c56bead65,updated_at=2022-09-04T01:06:50Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:06:50.398636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-f5740dd5-abe0-46de-9e40-85e86866d818 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (f75a9252-cb76-4ba1-beb9-387f2cc787ca), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:50.398962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-f5740dd5-abe0-46de-9e40-85e86866d818 admin admin] Security group rule updated ['6ca79921-cac2-48b6-b2fd-5f8c56bead65'] Sep 04 01:06:50.604661 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-a3ee84b7-11f7-432c-a409-a7594e008647 admin admin] Resource SecurityGroup deleted: 6ca79921-cac2-48b6-b2fd-5f8c56bead65 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:50.605095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-a3ee84b7-11f7-432c-a409-a7594e008647 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (6ca79921-cac2-48b6-b2fd-5f8c56bead65), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:50.605555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3ee84b7-11f7-432c-a409-a7594e008647 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('6ca79921-cac2-48b6-b2fd-5f8c56bead65',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:06:50.620382 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-a3ee84b7-11f7-432c-a409-a7594e008647 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('6ca79921-cac2-48b6-b2fd-5f8c56bead65',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:06:50.620869 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-a3ee84b7-11f7-432c-a409-a7594e008647 admin admin] Resource SecurityGroupRule deleted: 119411cd-85b5-4879-a299-2bc992b51cbe {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:50.621272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-a3ee84b7-11f7-432c-a409-a7594e008647 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (119411cd-85b5-4879-a299-2bc992b51cbe), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:50.621619 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-a3ee84b7-11f7-432c-a409-a7594e008647 admin admin] Security group rule updated ['6ca79921-cac2-48b6-b2fd-5f8c56bead65'] Sep 04 01:06:50.622053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-a3ee84b7-11f7-432c-a409-a7594e008647 admin admin] Resource SecurityGroupRule deleted: 5438bfa3-fd93-4107-a703-f72f9977d29d {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:50.622592 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-a3ee84b7-11f7-432c-a409-a7594e008647 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (5438bfa3-fd93-4107-a703-f72f9977d29d), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:50.622918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-a3ee84b7-11f7-432c-a409-a7594e008647 admin admin] Security group rule updated ['6ca79921-cac2-48b6-b2fd-5f8c56bead65'] Sep 04 01:06:50.623371 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-a3ee84b7-11f7-432c-a409-a7594e008647 admin admin] Resource SecurityGroupRule deleted: b7c72b8a-17ee-4d8b-ae0c-90cb8bbee69b {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:50.623719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-a3ee84b7-11f7-432c-a409-a7594e008647 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (b7c72b8a-17ee-4d8b-ae0c-90cb8bbee69b), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:50.624044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-a3ee84b7-11f7-432c-a409-a7594e008647 admin admin] Security group rule updated ['6ca79921-cac2-48b6-b2fd-5f8c56bead65'] Sep 04 01:06:50.624466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-a3ee84b7-11f7-432c-a409-a7594e008647 admin admin] Resource SecurityGroupRule deleted: f75a9252-cb76-4ba1-beb9-387f2cc787ca {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:06:50.624814 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-a3ee84b7-11f7-432c-a409-a7594e008647 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (f75a9252-cb76-4ba1-beb9-387f2cc787ca), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:50.625179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-a3ee84b7-11f7-432c-a409-a7594e008647 admin admin] Security group rule updated ['6ca79921-cac2-48b6-b2fd-5f8c56bead65'] Sep 04 01:06:52.255468 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:301 started Sep 04 01:06:52.260935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade556d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=650000000,duration_sec=621,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:06:52.261868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:06:52.262397 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:301 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 04 01:06:54.248338 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Resource Port 449add0b-213e-49af-b0f2-5656f19d796f updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:06:54.248949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (449add0b-213e-49af-b0f2-5656f19d796f), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:54.256209 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:302 started Sep 04 01:06:54.258867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade556f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=651000000,duration_sec=623,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:06:54.259448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:06:54.259777 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:302 - starting polling. Elapsed:0.004 Sep 04 01:06:54.262075 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:54.265050 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:302 - port information retrieved. Elapsed:0.009 Sep 04 01:06:54.265403 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:302 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 04 01:06:56.257879 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:303 started Sep 04 01:06:56.260565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5571,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=652000000,duration_sec=625,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:06:56.261164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:06:56.261522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:303 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:06:56.329176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Resource Port 449add0b-213e-49af-b0f2-5656f19d796f updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:06:56.329671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (449add0b-213e-49af-b0f2-5656f19d796f), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:58.259483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:304 started Sep 04 01:06:58.263434 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5573,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=654000000,duration_sec=627,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:06:58.264347 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:06:58.264904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:304 - starting polling. Elapsed:0.006 Sep 04 01:06:58.269265 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:06:58.272591 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:304 - port information retrieved. Elapsed:0.013 Sep 04 01:06:58.273108 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:304 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.014 Sep 04 01:07:00.260867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:305 started Sep 04 01:07:00.263450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5575,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=655000000,duration_sec=629,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:07:00.264018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:07:00.264370 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:305 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:07:02.261777 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:306 started Sep 04 01:07:02.265964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5577,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=656000000,duration_sec=631,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:07:02.266528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:07:02.267010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:306 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 04 01:07:04.262732 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:307 started Sep 04 01:07:04.265155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5579,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=657000000,duration_sec=633,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:07:04.265720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:07:04.266108 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:307 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:07:05.784628 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-e4ecff7f-4743-43b6-b363-618f5fc9e44f admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:07:05Z,description='Default security group',id=de7a455a-3875-4f24-97c7-a16ed97acf8c,is_default=True,name='default',project_id='abb283f343024bcd8dde457024425a7b',revision_number=1,rules=[SecurityGroupRule(0424deb4-36dd-4c30-9906-e73c563f3e48),SecurityGroupRule(884cefb6-c39a-4a46-a3cb-94895255cb29),SecurityGroupRule(c4c6b1d1-f15b-495a-b667-34709a03add2),SecurityGroupRule(e539c5ae-9d06-4012-9d6f-3b749f4e9f01)],shared=False,stateful=True,updated_at=2022-09-04T01:07:05Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:07:05.785292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-e4ecff7f-4743-43b6-b363-618f5fc9e44f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (de7a455a-3875-4f24-97c7-a16ed97acf8c), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:05.785607 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-e4ecff7f-4743-43b6-b363-618f5fc9e44f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:07:05Z,description=,direction='egress',ethertype='IPv6',id=0424deb4-36dd-4c30-9906-e73c563f3e48,normalized_cidr=None,port_range_max=,port_range_min=,project_id='abb283f343024bcd8dde457024425a7b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=de7a455a-3875-4f24-97c7-a16ed97acf8c,updated_at=2022-09-04T01:07:05Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:07:05.785970 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-e4ecff7f-4743-43b6-b363-618f5fc9e44f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (0424deb4-36dd-4c30-9906-e73c563f3e48), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:05.786306 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-e4ecff7f-4743-43b6-b363-618f5fc9e44f admin admin] Security group rule updated ['de7a455a-3875-4f24-97c7-a16ed97acf8c'] Sep 04 01:07:05.787059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-e4ecff7f-4743-43b6-b363-618f5fc9e44f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:07:05Z,description=,direction='ingress',ethertype='IPv6',id=884cefb6-c39a-4a46-a3cb-94895255cb29,normalized_cidr=None,port_range_max=,port_range_min=,project_id='abb283f343024bcd8dde457024425a7b',protocol=,remote_address_group_id=,remote_group_id=de7a455a-3875-4f24-97c7-a16ed97acf8c,remote_ip_prefix=,revision_number=0,security_group_id=de7a455a-3875-4f24-97c7-a16ed97acf8c,updated_at=2022-09-04T01:07:05Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:07:05.787415 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-e4ecff7f-4743-43b6-b363-618f5fc9e44f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (884cefb6-c39a-4a46-a3cb-94895255cb29), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:05.787744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-e4ecff7f-4743-43b6-b363-618f5fc9e44f admin admin] Security group rule updated ['de7a455a-3875-4f24-97c7-a16ed97acf8c'] Sep 04 01:07:05.788448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-e4ecff7f-4743-43b6-b363-618f5fc9e44f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:07:05Z,description=,direction='ingress',ethertype='IPv4',id=c4c6b1d1-f15b-495a-b667-34709a03add2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='abb283f343024bcd8dde457024425a7b',protocol=,remote_address_group_id=,remote_group_id=de7a455a-3875-4f24-97c7-a16ed97acf8c,remote_ip_prefix=,revision_number=0,security_group_id=de7a455a-3875-4f24-97c7-a16ed97acf8c,updated_at=2022-09-04T01:07:05Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:07:05.788800 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-e4ecff7f-4743-43b6-b363-618f5fc9e44f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (c4c6b1d1-f15b-495a-b667-34709a03add2), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:05.789150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-e4ecff7f-4743-43b6-b363-618f5fc9e44f admin admin] Security group rule updated ['de7a455a-3875-4f24-97c7-a16ed97acf8c'] Sep 04 01:07:05.789851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-e4ecff7f-4743-43b6-b363-618f5fc9e44f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:07:05Z,description=,direction='egress',ethertype='IPv4',id=e539c5ae-9d06-4012-9d6f-3b749f4e9f01,normalized_cidr=None,port_range_max=,port_range_min=,project_id='abb283f343024bcd8dde457024425a7b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=de7a455a-3875-4f24-97c7-a16ed97acf8c,updated_at=2022-09-04T01:07:05Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:07:05.790203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-e4ecff7f-4743-43b6-b363-618f5fc9e44f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (e539c5ae-9d06-4012-9d6f-3b749f4e9f01), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:05.796688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-e4ecff7f-4743-43b6-b363-618f5fc9e44f admin admin] Security group rule updated ['de7a455a-3875-4f24-97c7-a16ed97acf8c'] Sep 04 01:07:05.997161 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0bb25db3-7b08-41a2-936a-c5fdde4cf22c admin admin] Resource SecurityGroup deleted: de7a455a-3875-4f24-97c7-a16ed97acf8c {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:07:05.997553 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-0bb25db3-7b08-41a2-936a-c5fdde4cf22c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (de7a455a-3875-4f24-97c7-a16ed97acf8c), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:05.998023 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0bb25db3-7b08-41a2-936a-c5fdde4cf22c admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('de7a455a-3875-4f24-97c7-a16ed97acf8c',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:07:06.012211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0bb25db3-7b08-41a2-936a-c5fdde4cf22c admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('de7a455a-3875-4f24-97c7-a16ed97acf8c',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:07:06.012876 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0bb25db3-7b08-41a2-936a-c5fdde4cf22c admin admin] Resource SecurityGroupRule deleted: 0424deb4-36dd-4c30-9906-e73c563f3e48 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:07:06.013341 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-0bb25db3-7b08-41a2-936a-c5fdde4cf22c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (0424deb4-36dd-4c30-9906-e73c563f3e48), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:06.013746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-0bb25db3-7b08-41a2-936a-c5fdde4cf22c admin admin] Security group rule updated ['de7a455a-3875-4f24-97c7-a16ed97acf8c'] Sep 04 01:07:06.014274 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0bb25db3-7b08-41a2-936a-c5fdde4cf22c admin admin] Resource SecurityGroupRule deleted: 884cefb6-c39a-4a46-a3cb-94895255cb29 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:07:06.014746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-0bb25db3-7b08-41a2-936a-c5fdde4cf22c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (884cefb6-c39a-4a46-a3cb-94895255cb29), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:06.015132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-0bb25db3-7b08-41a2-936a-c5fdde4cf22c admin admin] Security group rule updated ['de7a455a-3875-4f24-97c7-a16ed97acf8c'] Sep 04 01:07:06.015560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0bb25db3-7b08-41a2-936a-c5fdde4cf22c admin admin] Resource SecurityGroupRule deleted: c4c6b1d1-f15b-495a-b667-34709a03add2 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:07:06.016216 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-0bb25db3-7b08-41a2-936a-c5fdde4cf22c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (c4c6b1d1-f15b-495a-b667-34709a03add2), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:06.016401 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-0bb25db3-7b08-41a2-936a-c5fdde4cf22c admin admin] Security group rule updated ['de7a455a-3875-4f24-97c7-a16ed97acf8c'] Sep 04 01:07:06.016870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0bb25db3-7b08-41a2-936a-c5fdde4cf22c admin admin] Resource SecurityGroupRule deleted: e539c5ae-9d06-4012-9d6f-3b749f4e9f01 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:07:06.017235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-0bb25db3-7b08-41a2-936a-c5fdde4cf22c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (e539c5ae-9d06-4012-9d6f-3b749f4e9f01), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:06.017710 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-0bb25db3-7b08-41a2-936a-c5fdde4cf22c admin admin] Security group rule updated ['de7a455a-3875-4f24-97c7-a16ed97acf8c'] Sep 04 01:07:06.263700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:308 started Sep 04 01:07:06.266124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade557b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=658000000,duration_sec=635,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:07:06.266695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:07:06.267046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:308 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:07:08.265319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:309 started Sep 04 01:07:08.268652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade557d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=660000000,duration_sec=637,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:07:08.269529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:07:08.270102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:309 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 04 01:07:09.288498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-e6d7d3ee-0af5-46a4-a8bd-b3ce98fc1168 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:07:09Z,description='Default security group',id=578611cf-9bd4-499b-896f-e5c520eb909c,is_default=True,name='default',project_id='f47f120d5fbd4b909d1550289b2256a5',revision_number=1,rules=[SecurityGroupRule(0b3cb53c-92c4-42c2-973c-77ad1cd26c5d),SecurityGroupRule(c788955b-8aa4-47d4-a15d-5a1e3bca13de),SecurityGroupRule(d3d41490-5146-468e-9ffb-59b766dbba30),SecurityGroupRule(f7a3726c-0bd9-44f4-bf32-e6cd2c8dd12a)],shared=False,stateful=True,updated_at=2022-09-04T01:07:09Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:07:09.289163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-e6d7d3ee-0af5-46a4-a8bd-b3ce98fc1168 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (578611cf-9bd4-499b-896f-e5c520eb909c), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:09.289719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-e6d7d3ee-0af5-46a4-a8bd-b3ce98fc1168 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:07:09Z,description=,direction='egress',ethertype='IPv6',id=0b3cb53c-92c4-42c2-973c-77ad1cd26c5d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f47f120d5fbd4b909d1550289b2256a5',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=578611cf-9bd4-499b-896f-e5c520eb909c,updated_at=2022-09-04T01:07:09Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:07:09.290185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-e6d7d3ee-0af5-46a4-a8bd-b3ce98fc1168 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (0b3cb53c-92c4-42c2-973c-77ad1cd26c5d), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:09.290610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-e6d7d3ee-0af5-46a4-a8bd-b3ce98fc1168 admin admin] Security group rule updated ['578611cf-9bd4-499b-896f-e5c520eb909c'] Sep 04 01:07:09.291450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-e6d7d3ee-0af5-46a4-a8bd-b3ce98fc1168 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:07:09Z,description=,direction='ingress',ethertype='IPv4',id=c788955b-8aa4-47d4-a15d-5a1e3bca13de,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f47f120d5fbd4b909d1550289b2256a5',protocol=,remote_address_group_id=,remote_group_id=578611cf-9bd4-499b-896f-e5c520eb909c,remote_ip_prefix=,revision_number=0,security_group_id=578611cf-9bd4-499b-896f-e5c520eb909c,updated_at=2022-09-04T01:07:09Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:07:09.291865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-e6d7d3ee-0af5-46a4-a8bd-b3ce98fc1168 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (c788955b-8aa4-47d4-a15d-5a1e3bca13de), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:09.292265 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-e6d7d3ee-0af5-46a4-a8bd-b3ce98fc1168 admin admin] Security group rule updated ['578611cf-9bd4-499b-896f-e5c520eb909c'] Sep 04 01:07:09.293027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-e6d7d3ee-0af5-46a4-a8bd-b3ce98fc1168 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:07:09Z,description=,direction='ingress',ethertype='IPv6',id=d3d41490-5146-468e-9ffb-59b766dbba30,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f47f120d5fbd4b909d1550289b2256a5',protocol=,remote_address_group_id=,remote_group_id=578611cf-9bd4-499b-896f-e5c520eb909c,remote_ip_prefix=,revision_number=0,security_group_id=578611cf-9bd4-499b-896f-e5c520eb909c,updated_at=2022-09-04T01:07:09Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:07:09.293465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-e6d7d3ee-0af5-46a4-a8bd-b3ce98fc1168 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (d3d41490-5146-468e-9ffb-59b766dbba30), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:09.293866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-e6d7d3ee-0af5-46a4-a8bd-b3ce98fc1168 admin admin] Security group rule updated ['578611cf-9bd4-499b-896f-e5c520eb909c'] Sep 04 01:07:09.294652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-e6d7d3ee-0af5-46a4-a8bd-b3ce98fc1168 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:07:09Z,description=,direction='egress',ethertype='IPv4',id=f7a3726c-0bd9-44f4-bf32-e6cd2c8dd12a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f47f120d5fbd4b909d1550289b2256a5',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=578611cf-9bd4-499b-896f-e5c520eb909c,updated_at=2022-09-04T01:07:09Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:07:09.295172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-e6d7d3ee-0af5-46a4-a8bd-b3ce98fc1168 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (f7a3726c-0bd9-44f4-bf32-e6cd2c8dd12a), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:09.295561 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-e6d7d3ee-0af5-46a4-a8bd-b3ce98fc1168 admin admin] Security group rule updated ['578611cf-9bd4-499b-896f-e5c520eb909c'] Sep 04 01:07:09.482335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-58a65d92-f046-4a3f-8cfa-62649e1ff041 admin admin] Resource SecurityGroup deleted: 578611cf-9bd4-499b-896f-e5c520eb909c {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:07:09.482743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-58a65d92-f046-4a3f-8cfa-62649e1ff041 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (578611cf-9bd4-499b-896f-e5c520eb909c), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:09.483363 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58a65d92-f046-4a3f-8cfa-62649e1ff041 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('578611cf-9bd4-499b-896f-e5c520eb909c',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:07:09.500476 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-58a65d92-f046-4a3f-8cfa-62649e1ff041 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('578611cf-9bd4-499b-896f-e5c520eb909c',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:07:09.500476 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-58a65d92-f046-4a3f-8cfa-62649e1ff041 admin admin] Resource SecurityGroupRule deleted: 0b3cb53c-92c4-42c2-973c-77ad1cd26c5d {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:07:09.500476 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-58a65d92-f046-4a3f-8cfa-62649e1ff041 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (0b3cb53c-92c4-42c2-973c-77ad1cd26c5d), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:09.500476 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-58a65d92-f046-4a3f-8cfa-62649e1ff041 admin admin] Security group rule updated ['578611cf-9bd4-499b-896f-e5c520eb909c'] Sep 04 01:07:09.500476 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-58a65d92-f046-4a3f-8cfa-62649e1ff041 admin admin] Resource SecurityGroupRule deleted: c788955b-8aa4-47d4-a15d-5a1e3bca13de {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:07:09.501000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-58a65d92-f046-4a3f-8cfa-62649e1ff041 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (c788955b-8aa4-47d4-a15d-5a1e3bca13de), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:09.501000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-58a65d92-f046-4a3f-8cfa-62649e1ff041 admin admin] Security group rule updated ['578611cf-9bd4-499b-896f-e5c520eb909c'] Sep 04 01:07:09.501000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-58a65d92-f046-4a3f-8cfa-62649e1ff041 admin admin] Resource SecurityGroupRule deleted: d3d41490-5146-468e-9ffb-59b766dbba30 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:07:09.501000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-58a65d92-f046-4a3f-8cfa-62649e1ff041 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (d3d41490-5146-468e-9ffb-59b766dbba30), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:09.501000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-58a65d92-f046-4a3f-8cfa-62649e1ff041 admin admin] Security group rule updated ['578611cf-9bd4-499b-896f-e5c520eb909c'] Sep 04 01:07:09.501426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-58a65d92-f046-4a3f-8cfa-62649e1ff041 admin admin] Resource SecurityGroupRule deleted: f7a3726c-0bd9-44f4-bf32-e6cd2c8dd12a {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:07:09.501558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-58a65d92-f046-4a3f-8cfa-62649e1ff041 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (f7a3726c-0bd9-44f4-bf32-e6cd2c8dd12a), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:09.501877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-58a65d92-f046-4a3f-8cfa-62649e1ff041 admin admin] Security group rule updated ['578611cf-9bd4-499b-896f-e5c520eb909c'] Sep 04 01:07:10.267187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:310 started Sep 04 01:07:10.269957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade557f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=661000000,duration_sec=639,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:07:10.270996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:07:10.274953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:310 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:07:10.375255 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c3d79470-6633-4bc5-8ed5-31a4246737ba admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:07:10Z,description='Default security group',id=12e4becb-3a1e-4627-b3af-48c7e3c0b67e,is_default=True,name='default',project_id='604187a2ab3645bbacaa14dfa446c3f6',revision_number=1,rules=[SecurityGroupRule(500aa9cd-996f-4aed-b433-9d5b281de6c8),SecurityGroupRule(6847f79f-43db-4133-84bb-5a90d170ba68),SecurityGroupRule(dd249c17-7946-49a9-a584-131c32fd86b6),SecurityGroupRule(fea1a13a-2e54-4387-8c0e-93e98795094a)],shared=False,stateful=True,updated_at=2022-09-04T01:07:10Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:07:10.375892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-c3d79470-6633-4bc5-8ed5-31a4246737ba admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (12e4becb-3a1e-4627-b3af-48c7e3c0b67e), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:10.376243 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c3d79470-6633-4bc5-8ed5-31a4246737ba admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:07:10Z,description=,direction='egress',ethertype='IPv6',id=500aa9cd-996f-4aed-b433-9d5b281de6c8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='604187a2ab3645bbacaa14dfa446c3f6',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=12e4becb-3a1e-4627-b3af-48c7e3c0b67e,updated_at=2022-09-04T01:07:10Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:07:10.376608 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-c3d79470-6633-4bc5-8ed5-31a4246737ba admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (500aa9cd-996f-4aed-b433-9d5b281de6c8), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:10.376948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-c3d79470-6633-4bc5-8ed5-31a4246737ba admin admin] Security group rule updated ['12e4becb-3a1e-4627-b3af-48c7e3c0b67e'] Sep 04 01:07:10.377695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c3d79470-6633-4bc5-8ed5-31a4246737ba admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:07:10Z,description=,direction='egress',ethertype='IPv4',id=6847f79f-43db-4133-84bb-5a90d170ba68,normalized_cidr=None,port_range_max=,port_range_min=,project_id='604187a2ab3645bbacaa14dfa446c3f6',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=12e4becb-3a1e-4627-b3af-48c7e3c0b67e,updated_at=2022-09-04T01:07:10Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:07:10.378047 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-c3d79470-6633-4bc5-8ed5-31a4246737ba admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (6847f79f-43db-4133-84bb-5a90d170ba68), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:10.378556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-c3d79470-6633-4bc5-8ed5-31a4246737ba admin admin] Security group rule updated ['12e4becb-3a1e-4627-b3af-48c7e3c0b67e'] Sep 04 01:07:10.379264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c3d79470-6633-4bc5-8ed5-31a4246737ba admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:07:10Z,description=,direction='ingress',ethertype='IPv6',id=dd249c17-7946-49a9-a584-131c32fd86b6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='604187a2ab3645bbacaa14dfa446c3f6',protocol=,remote_address_group_id=,remote_group_id=12e4becb-3a1e-4627-b3af-48c7e3c0b67e,remote_ip_prefix=,revision_number=0,security_group_id=12e4becb-3a1e-4627-b3af-48c7e3c0b67e,updated_at=2022-09-04T01:07:10Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:07:10.379751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-c3d79470-6633-4bc5-8ed5-31a4246737ba admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (dd249c17-7946-49a9-a584-131c32fd86b6), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:10.380081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-c3d79470-6633-4bc5-8ed5-31a4246737ba admin admin] Security group rule updated ['12e4becb-3a1e-4627-b3af-48c7e3c0b67e'] Sep 04 01:07:10.381045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c3d79470-6633-4bc5-8ed5-31a4246737ba admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:07:10Z,description=,direction='ingress',ethertype='IPv4',id=fea1a13a-2e54-4387-8c0e-93e98795094a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='604187a2ab3645bbacaa14dfa446c3f6',protocol=,remote_address_group_id=,remote_group_id=12e4becb-3a1e-4627-b3af-48c7e3c0b67e,remote_ip_prefix=,revision_number=0,security_group_id=12e4becb-3a1e-4627-b3af-48c7e3c0b67e,updated_at=2022-09-04T01:07:10Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:07:10.384087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-c3d79470-6633-4bc5-8ed5-31a4246737ba admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (fea1a13a-2e54-4387-8c0e-93e98795094a), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:10.384087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-c3d79470-6633-4bc5-8ed5-31a4246737ba admin admin] Security group rule updated ['12e4becb-3a1e-4627-b3af-48c7e3c0b67e'] Sep 04 01:07:10.741017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-e9f96588-371c-4640-a3d8-2189e5b7f3d6 admin admin] Resource SecurityGroup deleted: 12e4becb-3a1e-4627-b3af-48c7e3c0b67e {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:07:10.741501 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-e9f96588-371c-4640-a3d8-2189e5b7f3d6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (12e4becb-3a1e-4627-b3af-48c7e3c0b67e), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:10.742028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9f96588-371c-4640-a3d8-2189e5b7f3d6 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('12e4becb-3a1e-4627-b3af-48c7e3c0b67e',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:07:10.755923 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-e9f96588-371c-4640-a3d8-2189e5b7f3d6 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('12e4becb-3a1e-4627-b3af-48c7e3c0b67e',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:07:10.756429 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-e9f96588-371c-4640-a3d8-2189e5b7f3d6 admin admin] Resource SecurityGroupRule deleted: 500aa9cd-996f-4aed-b433-9d5b281de6c8 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:07:10.756980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-e9f96588-371c-4640-a3d8-2189e5b7f3d6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (500aa9cd-996f-4aed-b433-9d5b281de6c8), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:10.757359 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-e9f96588-371c-4640-a3d8-2189e5b7f3d6 admin admin] Security group rule updated ['12e4becb-3a1e-4627-b3af-48c7e3c0b67e'] Sep 04 01:07:10.757803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-e9f96588-371c-4640-a3d8-2189e5b7f3d6 admin admin] Resource SecurityGroupRule deleted: 6847f79f-43db-4133-84bb-5a90d170ba68 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:07:10.758159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-e9f96588-371c-4640-a3d8-2189e5b7f3d6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (6847f79f-43db-4133-84bb-5a90d170ba68), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:10.758486 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-e9f96588-371c-4640-a3d8-2189e5b7f3d6 admin admin] Security group rule updated ['12e4becb-3a1e-4627-b3af-48c7e3c0b67e'] Sep 04 01:07:10.758915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-e9f96588-371c-4640-a3d8-2189e5b7f3d6 admin admin] Resource SecurityGroupRule deleted: dd249c17-7946-49a9-a584-131c32fd86b6 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:07:10.759290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-e9f96588-371c-4640-a3d8-2189e5b7f3d6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (dd249c17-7946-49a9-a584-131c32fd86b6), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:10.759613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-e9f96588-371c-4640-a3d8-2189e5b7f3d6 admin admin] Security group rule updated ['12e4becb-3a1e-4627-b3af-48c7e3c0b67e'] Sep 04 01:07:10.760055 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-e9f96588-371c-4640-a3d8-2189e5b7f3d6 admin admin] Resource SecurityGroupRule deleted: fea1a13a-2e54-4387-8c0e-93e98795094a {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:07:10.760497 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-e9f96588-371c-4640-a3d8-2189e5b7f3d6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (fea1a13a-2e54-4387-8c0e-93e98795094a), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:10.760826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-e9f96588-371c-4640-a3d8-2189e5b7f3d6 admin admin] Security group rule updated ['12e4becb-3a1e-4627-b3af-48c7e3c0b67e'] Sep 04 01:07:12.268396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:311 started Sep 04 01:07:12.271386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5581,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=662000000,duration_sec=641,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:07:12.272054 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:07:12.272404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:311 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:07:14.269233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:312 started Sep 04 01:07:14.272977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5583,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=664000000,duration_sec=643,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:07:14.273607 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:07:14.273958 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:312 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 04 01:07:16.270204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:313 started Sep 04 01:07:16.272566 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5585,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=664000000,duration_sec=645,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:07:16.273221 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:07:16.273572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:313 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:07:18.270989 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:314 started Sep 04 01:07:18.273781 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5587,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=665000000,duration_sec=647,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:07:18.274350 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:07:18.274699 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:314 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:07:20.272142 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:315 started Sep 04 01:07:20.274599 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5589,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=666000000,duration_sec=649,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:07:20.275183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:07:20.275534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:315 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:07:20.919579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-90e79c2e-aa85-4260-87a1-0ab64e5f23ba admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:07:20Z,description='Default security group',id=f0270cfb-26c2-4b4e-996b-1eae29b9fd5e,is_default=True,name='default',project_id='2578bf50dc5948f6a7a9373cb020282b',revision_number=1,rules=[SecurityGroupRule(64d09570-74d5-4825-ac80-0c769fefacc7),SecurityGroupRule(9343e3d3-72e4-476c-abda-08260118bb93),SecurityGroupRule(a63eb139-819b-42e5-93d7-a4dc3dfc66c1),SecurityGroupRule(fc165d84-90bd-41b7-8a8d-2a2d0174950a)],shared=False,stateful=True,updated_at=2022-09-04T01:07:20Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:07:20.920159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-90e79c2e-aa85-4260-87a1-0ab64e5f23ba admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (f0270cfb-26c2-4b4e-996b-1eae29b9fd5e), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:20.921050 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-90e79c2e-aa85-4260-87a1-0ab64e5f23ba admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:07:20Z,description=,direction='egress',ethertype='IPv4',id=64d09570-74d5-4825-ac80-0c769fefacc7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2578bf50dc5948f6a7a9373cb020282b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=f0270cfb-26c2-4b4e-996b-1eae29b9fd5e,updated_at=2022-09-04T01:07:20Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:07:20.921614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-90e79c2e-aa85-4260-87a1-0ab64e5f23ba admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (64d09570-74d5-4825-ac80-0c769fefacc7), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:20.922164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-90e79c2e-aa85-4260-87a1-0ab64e5f23ba admin admin] Security group rule updated ['f0270cfb-26c2-4b4e-996b-1eae29b9fd5e'] Sep 04 01:07:20.923033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-90e79c2e-aa85-4260-87a1-0ab64e5f23ba admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:07:20Z,description=,direction='ingress',ethertype='IPv6',id=9343e3d3-72e4-476c-abda-08260118bb93,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2578bf50dc5948f6a7a9373cb020282b',protocol=,remote_address_group_id=,remote_group_id=f0270cfb-26c2-4b4e-996b-1eae29b9fd5e,remote_ip_prefix=,revision_number=0,security_group_id=f0270cfb-26c2-4b4e-996b-1eae29b9fd5e,updated_at=2022-09-04T01:07:20Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:07:20.923600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-90e79c2e-aa85-4260-87a1-0ab64e5f23ba admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (9343e3d3-72e4-476c-abda-08260118bb93), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:20.924114 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-90e79c2e-aa85-4260-87a1-0ab64e5f23ba admin admin] Security group rule updated ['f0270cfb-26c2-4b4e-996b-1eae29b9fd5e'] Sep 04 01:07:20.924958 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-90e79c2e-aa85-4260-87a1-0ab64e5f23ba admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:07:20Z,description=,direction='ingress',ethertype='IPv4',id=a63eb139-819b-42e5-93d7-a4dc3dfc66c1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2578bf50dc5948f6a7a9373cb020282b',protocol=,remote_address_group_id=,remote_group_id=f0270cfb-26c2-4b4e-996b-1eae29b9fd5e,remote_ip_prefix=,revision_number=0,security_group_id=f0270cfb-26c2-4b4e-996b-1eae29b9fd5e,updated_at=2022-09-04T01:07:20Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:07:20.925490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-90e79c2e-aa85-4260-87a1-0ab64e5f23ba admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (a63eb139-819b-42e5-93d7-a4dc3dfc66c1), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:20.926037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-90e79c2e-aa85-4260-87a1-0ab64e5f23ba admin admin] Security group rule updated ['f0270cfb-26c2-4b4e-996b-1eae29b9fd5e'] Sep 04 01:07:20.926989 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-90e79c2e-aa85-4260-87a1-0ab64e5f23ba admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:07:20Z,description=,direction='egress',ethertype='IPv6',id=fc165d84-90bd-41b7-8a8d-2a2d0174950a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2578bf50dc5948f6a7a9373cb020282b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=f0270cfb-26c2-4b4e-996b-1eae29b9fd5e,updated_at=2022-09-04T01:07:20Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:07:20.927484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-90e79c2e-aa85-4260-87a1-0ab64e5f23ba admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (fc165d84-90bd-41b7-8a8d-2a2d0174950a), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:20.927962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-90e79c2e-aa85-4260-87a1-0ab64e5f23ba admin admin] Security group rule updated ['f0270cfb-26c2-4b4e-996b-1eae29b9fd5e'] Sep 04 01:07:21.135522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-a92e996f-3a09-4bee-923f-fd418c5a4383 admin admin] Resource SecurityGroup deleted: f0270cfb-26c2-4b4e-996b-1eae29b9fd5e {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:07:21.136034 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-a92e996f-3a09-4bee-923f-fd418c5a4383 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (f0270cfb-26c2-4b4e-996b-1eae29b9fd5e), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:21.136612 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a92e996f-3a09-4bee-923f-fd418c5a4383 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('f0270cfb-26c2-4b4e-996b-1eae29b9fd5e',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:07:21.150838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-a92e996f-3a09-4bee-923f-fd418c5a4383 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('f0270cfb-26c2-4b4e-996b-1eae29b9fd5e',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:07:21.151539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-a92e996f-3a09-4bee-923f-fd418c5a4383 admin admin] Resource SecurityGroupRule deleted: 64d09570-74d5-4825-ac80-0c769fefacc7 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:07:21.152171 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-a92e996f-3a09-4bee-923f-fd418c5a4383 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (64d09570-74d5-4825-ac80-0c769fefacc7), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:21.152507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-a92e996f-3a09-4bee-923f-fd418c5a4383 admin admin] Security group rule updated ['f0270cfb-26c2-4b4e-996b-1eae29b9fd5e'] Sep 04 01:07:21.153097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-a92e996f-3a09-4bee-923f-fd418c5a4383 admin admin] Resource SecurityGroupRule deleted: 9343e3d3-72e4-476c-abda-08260118bb93 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:07:21.153470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-a92e996f-3a09-4bee-923f-fd418c5a4383 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (9343e3d3-72e4-476c-abda-08260118bb93), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:21.153812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-a92e996f-3a09-4bee-923f-fd418c5a4383 admin admin] Security group rule updated ['f0270cfb-26c2-4b4e-996b-1eae29b9fd5e'] Sep 04 01:07:21.154221 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-a92e996f-3a09-4bee-923f-fd418c5a4383 admin admin] Resource SecurityGroupRule deleted: a63eb139-819b-42e5-93d7-a4dc3dfc66c1 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:07:21.154567 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-a92e996f-3a09-4bee-923f-fd418c5a4383 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (a63eb139-819b-42e5-93d7-a4dc3dfc66c1), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:21.155011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-a92e996f-3a09-4bee-923f-fd418c5a4383 admin admin] Security group rule updated ['f0270cfb-26c2-4b4e-996b-1eae29b9fd5e'] Sep 04 01:07:21.155430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-a92e996f-3a09-4bee-923f-fd418c5a4383 admin admin] Resource SecurityGroupRule deleted: fc165d84-90bd-41b7-8a8d-2a2d0174950a {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:07:21.155772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-a92e996f-3a09-4bee-923f-fd418c5a4383 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (fc165d84-90bd-41b7-8a8d-2a2d0174950a), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:21.156090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-a92e996f-3a09-4bee-923f-fd418c5a4383 admin admin] Security group rule updated ['f0270cfb-26c2-4b4e-996b-1eae29b9fd5e'] Sep 04 01:07:22.272704 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:316 started Sep 04 01:07:22.278051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade558b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=667000000,duration_sec=651,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:07:22.278051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:07:22.278051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:316 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:07:22.881216 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-583f0fbd-311a-48c8-a5b4-5d74d09e654d admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:07:22Z,description='Default security group',id=77d92f6f-80be-4de3-97f2-06705211b2de,is_default=True,name='default',project_id='d57426a3bc074d01b88e5fb9cb7fa71e',revision_number=1,rules=[SecurityGroupRule(4bd62fb9-18a5-4e88-9cf4-55f4d0d6160e),SecurityGroupRule(75481e18-becf-4040-a1a4-03ce77845bb5),SecurityGroupRule(b6779a09-3da5-4a2b-8cf6-6483e4231f32),SecurityGroupRule(ed8a753e-1150-4e99-b8f2-0c85e1ce1f61)],shared=False,stateful=True,updated_at=2022-09-04T01:07:22Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:07:22.881860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-583f0fbd-311a-48c8-a5b4-5d74d09e654d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (77d92f6f-80be-4de3-97f2-06705211b2de), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:22.882484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-583f0fbd-311a-48c8-a5b4-5d74d09e654d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:07:22Z,description=,direction='egress',ethertype='IPv6',id=4bd62fb9-18a5-4e88-9cf4-55f4d0d6160e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d57426a3bc074d01b88e5fb9cb7fa71e',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=77d92f6f-80be-4de3-97f2-06705211b2de,updated_at=2022-09-04T01:07:22Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:07:22.882907 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-583f0fbd-311a-48c8-a5b4-5d74d09e654d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (4bd62fb9-18a5-4e88-9cf4-55f4d0d6160e), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:22.883446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-583f0fbd-311a-48c8-a5b4-5d74d09e654d admin admin] Security group rule updated ['77d92f6f-80be-4de3-97f2-06705211b2de'] Sep 04 01:07:22.884194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-583f0fbd-311a-48c8-a5b4-5d74d09e654d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:07:22Z,description=,direction='egress',ethertype='IPv4',id=75481e18-becf-4040-a1a4-03ce77845bb5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d57426a3bc074d01b88e5fb9cb7fa71e',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=77d92f6f-80be-4de3-97f2-06705211b2de,updated_at=2022-09-04T01:07:22Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:07:22.884548 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-583f0fbd-311a-48c8-a5b4-5d74d09e654d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (75481e18-becf-4040-a1a4-03ce77845bb5), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:22.884875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-583f0fbd-311a-48c8-a5b4-5d74d09e654d admin admin] Security group rule updated ['77d92f6f-80be-4de3-97f2-06705211b2de'] Sep 04 01:07:22.885608 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-583f0fbd-311a-48c8-a5b4-5d74d09e654d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:07:22Z,description=,direction='ingress',ethertype='IPv6',id=b6779a09-3da5-4a2b-8cf6-6483e4231f32,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d57426a3bc074d01b88e5fb9cb7fa71e',protocol=,remote_address_group_id=,remote_group_id=77d92f6f-80be-4de3-97f2-06705211b2de,remote_ip_prefix=,revision_number=0,security_group_id=77d92f6f-80be-4de3-97f2-06705211b2de,updated_at=2022-09-04T01:07:22Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:07:22.885958 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-583f0fbd-311a-48c8-a5b4-5d74d09e654d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (b6779a09-3da5-4a2b-8cf6-6483e4231f32), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:22.886284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-583f0fbd-311a-48c8-a5b4-5d74d09e654d admin admin] Security group rule updated ['77d92f6f-80be-4de3-97f2-06705211b2de'] Sep 04 01:07:22.886985 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-583f0fbd-311a-48c8-a5b4-5d74d09e654d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:07:22Z,description=,direction='ingress',ethertype='IPv4',id=ed8a753e-1150-4e99-b8f2-0c85e1ce1f61,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d57426a3bc074d01b88e5fb9cb7fa71e',protocol=,remote_address_group_id=,remote_group_id=77d92f6f-80be-4de3-97f2-06705211b2de,remote_ip_prefix=,revision_number=0,security_group_id=77d92f6f-80be-4de3-97f2-06705211b2de,updated_at=2022-09-04T01:07:22Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:07:22.887336 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-583f0fbd-311a-48c8-a5b4-5d74d09e654d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (ed8a753e-1150-4e99-b8f2-0c85e1ce1f61), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:22.887664 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-583f0fbd-311a-48c8-a5b4-5d74d09e654d admin admin] Security group rule updated ['77d92f6f-80be-4de3-97f2-06705211b2de'] Sep 04 01:07:23.051702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-e1b1efe0-8690-4562-9d7b-1c5fcf323b92 admin admin] Resource SecurityGroup deleted: 77d92f6f-80be-4de3-97f2-06705211b2de {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:07:23.052514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-e1b1efe0-8690-4562-9d7b-1c5fcf323b92 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (77d92f6f-80be-4de3-97f2-06705211b2de), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:23.053039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1b1efe0-8690-4562-9d7b-1c5fcf323b92 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('77d92f6f-80be-4de3-97f2-06705211b2de',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:07:23.066278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-e1b1efe0-8690-4562-9d7b-1c5fcf323b92 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('77d92f6f-80be-4de3-97f2-06705211b2de',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:07:23.067624 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-e1b1efe0-8690-4562-9d7b-1c5fcf323b92 admin admin] Resource SecurityGroupRule deleted: 4bd62fb9-18a5-4e88-9cf4-55f4d0d6160e {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:07:23.068785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-e1b1efe0-8690-4562-9d7b-1c5fcf323b92 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (4bd62fb9-18a5-4e88-9cf4-55f4d0d6160e), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:23.069655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-e1b1efe0-8690-4562-9d7b-1c5fcf323b92 admin admin] Security group rule updated ['77d92f6f-80be-4de3-97f2-06705211b2de'] Sep 04 01:07:23.070102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-e1b1efe0-8690-4562-9d7b-1c5fcf323b92 admin admin] Resource SecurityGroupRule deleted: 75481e18-becf-4040-a1a4-03ce77845bb5 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:07:23.070454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-e1b1efe0-8690-4562-9d7b-1c5fcf323b92 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (75481e18-becf-4040-a1a4-03ce77845bb5), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:23.070780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-e1b1efe0-8690-4562-9d7b-1c5fcf323b92 admin admin] Security group rule updated ['77d92f6f-80be-4de3-97f2-06705211b2de'] Sep 04 01:07:23.071474 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-e1b1efe0-8690-4562-9d7b-1c5fcf323b92 admin admin] Resource SecurityGroupRule deleted: b6779a09-3da5-4a2b-8cf6-6483e4231f32 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:07:23.071593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-e1b1efe0-8690-4562-9d7b-1c5fcf323b92 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (b6779a09-3da5-4a2b-8cf6-6483e4231f32), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:23.071937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-e1b1efe0-8690-4562-9d7b-1c5fcf323b92 admin admin] Security group rule updated ['77d92f6f-80be-4de3-97f2-06705211b2de'] Sep 04 01:07:23.072375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-e1b1efe0-8690-4562-9d7b-1c5fcf323b92 admin admin] Resource SecurityGroupRule deleted: ed8a753e-1150-4e99-b8f2-0c85e1ce1f61 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:07:23.072770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-e1b1efe0-8690-4562-9d7b-1c5fcf323b92 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (ed8a753e-1150-4e99-b8f2-0c85e1ce1f61), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:23.073125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-e1b1efe0-8690-4562-9d7b-1c5fcf323b92 admin admin] Security group rule updated ['77d92f6f-80be-4de3-97f2-06705211b2de'] Sep 04 01:07:24.274250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:317 started Sep 04 01:07:24.283909 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade558d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=669000000,duration_sec=653,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:07:24.287494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:07:24.287494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:317 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 04 01:07:24.474937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-43702b3e-1d07-4be2-b053-8e033d788f85 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:07:24Z,description='Default security group',id=47886e6f-b931-4c89-84ae-31a8725f8d25,is_default=True,name='default',project_id='bcf6c738f8d842f99d2eec3b896c5b47',revision_number=1,rules=[SecurityGroupRule(188cdfd3-71c3-4778-914a-172fe6073a2e),SecurityGroupRule(6828446d-9807-4a73-adb3-e47e2751c59f),SecurityGroupRule(852b00e5-4c60-48b0-92af-c39bd15eb248),SecurityGroupRule(aeae4815-f7ab-4fc2-9e89-a19929ca73cb)],shared=False,stateful=True,updated_at=2022-09-04T01:07:24Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:07:24.475334 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-43702b3e-1d07-4be2-b053-8e033d788f85 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (47886e6f-b931-4c89-84ae-31a8725f8d25), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:24.475961 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-43702b3e-1d07-4be2-b053-8e033d788f85 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:07:24Z,description=,direction='egress',ethertype='IPv6',id=188cdfd3-71c3-4778-914a-172fe6073a2e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='bcf6c738f8d842f99d2eec3b896c5b47',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=47886e6f-b931-4c89-84ae-31a8725f8d25,updated_at=2022-09-04T01:07:24Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:07:24.476328 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-43702b3e-1d07-4be2-b053-8e033d788f85 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (188cdfd3-71c3-4778-914a-172fe6073a2e), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:24.476696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-43702b3e-1d07-4be2-b053-8e033d788f85 admin admin] Security group rule updated ['47886e6f-b931-4c89-84ae-31a8725f8d25'] Sep 04 01:07:24.477473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-43702b3e-1d07-4be2-b053-8e033d788f85 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:07:24Z,description=,direction='ingress',ethertype='IPv4',id=6828446d-9807-4a73-adb3-e47e2751c59f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='bcf6c738f8d842f99d2eec3b896c5b47',protocol=,remote_address_group_id=,remote_group_id=47886e6f-b931-4c89-84ae-31a8725f8d25,remote_ip_prefix=,revision_number=0,security_group_id=47886e6f-b931-4c89-84ae-31a8725f8d25,updated_at=2022-09-04T01:07:24Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:07:24.477826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-43702b3e-1d07-4be2-b053-8e033d788f85 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (6828446d-9807-4a73-adb3-e47e2751c59f), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:24.478157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-43702b3e-1d07-4be2-b053-8e033d788f85 admin admin] Security group rule updated ['47886e6f-b931-4c89-84ae-31a8725f8d25'] Sep 04 01:07:24.479493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-43702b3e-1d07-4be2-b053-8e033d788f85 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:07:24Z,description=,direction='egress',ethertype='IPv4',id=852b00e5-4c60-48b0-92af-c39bd15eb248,normalized_cidr=None,port_range_max=,port_range_min=,project_id='bcf6c738f8d842f99d2eec3b896c5b47',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=47886e6f-b931-4c89-84ae-31a8725f8d25,updated_at=2022-09-04T01:07:24Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:07:24.479941 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-43702b3e-1d07-4be2-b053-8e033d788f85 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (852b00e5-4c60-48b0-92af-c39bd15eb248), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:24.480168 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-43702b3e-1d07-4be2-b053-8e033d788f85 admin admin] Security group rule updated ['47886e6f-b931-4c89-84ae-31a8725f8d25'] Sep 04 01:07:24.480881 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-43702b3e-1d07-4be2-b053-8e033d788f85 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:07:24Z,description=,direction='ingress',ethertype='IPv6',id=aeae4815-f7ab-4fc2-9e89-a19929ca73cb,normalized_cidr=None,port_range_max=,port_range_min=,project_id='bcf6c738f8d842f99d2eec3b896c5b47',protocol=,remote_address_group_id=,remote_group_id=47886e6f-b931-4c89-84ae-31a8725f8d25,remote_ip_prefix=,revision_number=0,security_group_id=47886e6f-b931-4c89-84ae-31a8725f8d25,updated_at=2022-09-04T01:07:24Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:07:24.481261 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-43702b3e-1d07-4be2-b053-8e033d788f85 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (aeae4815-f7ab-4fc2-9e89-a19929ca73cb), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:24.481823 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-43702b3e-1d07-4be2-b053-8e033d788f85 admin admin] Security group rule updated ['47886e6f-b931-4c89-84ae-31a8725f8d25'] Sep 04 01:07:24.682158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-43702b3e-1d07-4be2-b053-8e033d788f85 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-04T01:07:24Z,description='',dns_domain=None,id=7e04f73d-bad8-4860-94c2-08b2d4e17fa9,mtu=1500,name='tempest-VolumesActionsTest-319149119-network',project_id='bcf6c738f8d842f99d2eec3b896c5b47',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(7e04f73d-bad8-4860-94c2-08b2d4e17fa9),segments=[NetworkSegment(4b145fcd-b870-4624-8e9b-50fe2a121117)],shared=False,status='ACTIVE',updated_at=2022-09-04T01:07:24Z,vlan_transparent=) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:07:24.682539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-43702b3e-1d07-4be2-b053-8e033d788f85 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533'] for Network (7e04f73d-bad8-4860-94c2-08b2d4e17fa9), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:24.762184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager [None req-43702b3e-1d07-4be2-b053-8e033d788f85 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 7e04f73d-bad8-4860-94c2-08b2d4e17fa9 with segmentation id not found. Sep 04 01:07:24.762184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 04 01:07:24.762184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 04 01:07:24.762184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 04 01:07:24.762184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 04 01:07:24.762184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 04 01:07:24.762184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 04 01:07:24.762184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 04 01:07:24.762184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 04 01:07:24.762184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 04 01:07:24.762184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 04 01:07:24.762184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 04 01:07:24.762184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 04 01:07:24.770053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 04 01:07:24.770053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 04 01:07:24.770053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 04 01:07:24.770053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 7e04f73d-bad8-4860-94c2-08b2d4e17fa9 with segmentation id not found. Sep 04 01:07:24.770053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager Sep 04 01:07:25.177431 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-f5c9c3c0-ce09-4074-9988-30fa92604d32 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(29d3fec0-e774-4d72-855e-17e1e5fecc28)],cidr=172.20.0.0/28,created_at=2022-09-04T01:07:24Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=False,gateway_ip=172.20.0.1,host_routes=[],id=1715ca4f-993d-4984-97fb-84481d321a38,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-VolumesActionsTest-319149119-subnet',network_id=7e04f73d-bad8-4860-94c2-08b2d4e17fa9,project_id='bcf6c738f8d842f99d2eec3b896c5b47',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-04T01:07:24Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:07:25.177805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-f5c9c3c0-ce09-4074-9988-30fa92604d32 admin admin] Publish callbacks [] for Subnet (1715ca4f-993d-4984-97fb-84481d321a38), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:26.275083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:318 started Sep 04 01:07:26.281584 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade558f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=669000000,duration_sec=655,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:07:26.282411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:07:26.282774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:318 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 04 01:07:28.275779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:319 started Sep 04 01:07:28.278608 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5591,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=670000000,duration_sec=657,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:07:28.279199 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:07:28.282586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:319 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:07:28.949031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-63e94454-95d7-4be7-bdb7-46e09ddba9b4 tempest-ServerRescueNegativeTestJSON-1367456352 tempest-ServerRescueNegativeTestJSON-1367456352-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:07:28Z,description='tempest-description--230819015',id=408a6cc9-789d-4d36-bc4c-5052f5aa27fe,is_default=False,name='tempest-securitygroup--938530870',project_id='db72b63281384bd883b04d05bcc35677',revision_number=1,rules=[SecurityGroupRule(40dc393e-5720-4d65-b13b-03dd5a9dbb29),SecurityGroupRule(aa56283d-3d01-4d74-b695-8bba9f8043d4)],shared=False,stateful=True,updated_at=2022-09-04T01:07:28Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:07:28.949711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-63e94454-95d7-4be7-bdb7-46e09ddba9b4 tempest-ServerRescueNegativeTestJSON-1367456352 tempest-ServerRescueNegativeTestJSON-1367456352-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (408a6cc9-789d-4d36-bc4c-5052f5aa27fe), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:28.950492 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-63e94454-95d7-4be7-bdb7-46e09ddba9b4 tempest-ServerRescueNegativeTestJSON-1367456352 tempest-ServerRescueNegativeTestJSON-1367456352-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:07:28Z,description=,direction='egress',ethertype='IPv4',id=40dc393e-5720-4d65-b13b-03dd5a9dbb29,normalized_cidr=None,port_range_max=,port_range_min=,project_id='db72b63281384bd883b04d05bcc35677',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=408a6cc9-789d-4d36-bc4c-5052f5aa27fe,updated_at=2022-09-04T01:07:28Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:07:28.950866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-63e94454-95d7-4be7-bdb7-46e09ddba9b4 tempest-ServerRescueNegativeTestJSON-1367456352 tempest-ServerRescueNegativeTestJSON-1367456352-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (40dc393e-5720-4d65-b13b-03dd5a9dbb29), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:28.951236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-63e94454-95d7-4be7-bdb7-46e09ddba9b4 tempest-ServerRescueNegativeTestJSON-1367456352 tempest-ServerRescueNegativeTestJSON-1367456352-project] Security group rule updated ['408a6cc9-789d-4d36-bc4c-5052f5aa27fe'] Sep 04 01:07:28.951959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-63e94454-95d7-4be7-bdb7-46e09ddba9b4 tempest-ServerRescueNegativeTestJSON-1367456352 tempest-ServerRescueNegativeTestJSON-1367456352-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:07:28Z,description=,direction='egress',ethertype='IPv6',id=aa56283d-3d01-4d74-b695-8bba9f8043d4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='db72b63281384bd883b04d05bcc35677',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=408a6cc9-789d-4d36-bc4c-5052f5aa27fe,updated_at=2022-09-04T01:07:28Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:07:28.952317 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-63e94454-95d7-4be7-bdb7-46e09ddba9b4 tempest-ServerRescueNegativeTestJSON-1367456352 tempest-ServerRescueNegativeTestJSON-1367456352-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (aa56283d-3d01-4d74-b695-8bba9f8043d4), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:28.952678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-63e94454-95d7-4be7-bdb7-46e09ddba9b4 tempest-ServerRescueNegativeTestJSON-1367456352 tempest-ServerRescueNegativeTestJSON-1367456352-project] Security group rule updated ['408a6cc9-789d-4d36-bc4c-5052f5aa27fe'] Sep 04 01:07:29.401935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-9b90cffd-c9c2-441a-a737-d5b675e2143f tempest-ServerRescueNegativeTestJSON-1367456352 tempest-ServerRescueNegativeTestJSON-1367456352-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:07:29Z,description='',direction='ingress',ethertype='IPv4',id=18c583c9-f7ad-49a0-a17e-8451d28c139a,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='db72b63281384bd883b04d05bcc35677',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=408a6cc9-789d-4d36-bc4c-5052f5aa27fe,updated_at=2022-09-04T01:07:29Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:07:29.402580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-9b90cffd-c9c2-441a-a737-d5b675e2143f tempest-ServerRescueNegativeTestJSON-1367456352 tempest-ServerRescueNegativeTestJSON-1367456352-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (18c583c9-f7ad-49a0-a17e-8451d28c139a), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:29.402703 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-9b90cffd-c9c2-441a-a737-d5b675e2143f tempest-ServerRescueNegativeTestJSON-1367456352 tempest-ServerRescueNegativeTestJSON-1367456352-project] Security group rule updated ['408a6cc9-789d-4d36-bc4c-5052f5aa27fe'] Sep 04 01:07:29.840981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0ff02d14-3c3c-444d-8a9e-d79fbb753c03 tempest-ServerRescueNegativeTestJSON-1367456352 tempest-ServerRescueNegativeTestJSON-1367456352-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:07:29Z,description='',direction='ingress',ethertype='IPv4',id=647b96b9-953e-4175-a178-3f0e22532333,normalized_cidr=None,port_range_max=,port_range_min=,project_id='db72b63281384bd883b04d05bcc35677',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=408a6cc9-789d-4d36-bc4c-5052f5aa27fe,updated_at=2022-09-04T01:07:29Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:07:29.841397 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-0ff02d14-3c3c-444d-8a9e-d79fbb753c03 tempest-ServerRescueNegativeTestJSON-1367456352 tempest-ServerRescueNegativeTestJSON-1367456352-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (647b96b9-953e-4175-a178-3f0e22532333), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:29.841739 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-0ff02d14-3c3c-444d-8a9e-d79fbb753c03 tempest-ServerRescueNegativeTestJSON-1367456352 tempest-ServerRescueNegativeTestJSON-1367456352-project] Security group rule updated ['408a6cc9-789d-4d36-bc4c-5052f5aa27fe'] Sep 04 01:07:30.276648 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:320 started Sep 04 01:07:30.279507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5593,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=671000000,duration_sec=659,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:07:30.280745 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:07:30.280745 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:320 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:07:30.884975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-f37f6326-a0a9-4f22-a843-38484d995dd1 tempest-ServerRescueNegativeTestJSON-1367456352 tempest-ServerRescueNegativeTestJSON-1367456352-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:07:30Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=6c428213-1413-4eee-be61-4999c8f0b190,mac_address=fa:16:3e:f1:2f:60,name='',network_id=e8e0564a-d5c9-4fe0-b2d4-538f45096708,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(6c428213-1413-4eee-be61-4999c8f0b190),security_group_ids=set([]),status='N/A',updated_at=2022-09-04T01:07:30Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:07:30.884975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-f37f6326-a0a9-4f22-a843-38484d995dd1 tempest-ServerRescueNegativeTestJSON-1367456352 tempest-ServerRescueNegativeTestJSON-1367456352-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (6c428213-1413-4eee-be61-4999c8f0b190), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:31.455180 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-f37f6326-a0a9-4f22-a843-38484d995dd1 tempest-ServerRescueNegativeTestJSON-1367456352 tempest-ServerRescueNegativeTestJSON-1367456352-project] Resource Port 6c428213-1413-4eee-be61-4999c8f0b190 updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': 'd5d6fe9f-6323-4c53-a7b6-3bbe1545f3f4'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:07:31.455548 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-f37f6326-a0a9-4f22-a843-38484d995dd1 tempest-ServerRescueNegativeTestJSON-1367456352 tempest-ServerRescueNegativeTestJSON-1367456352-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (6c428213-1413-4eee-be61-4999c8f0b190), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:32.277456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:321 started Sep 04 01:07:32.280849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5595,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=671000000,duration_sec=661,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:07:32.281516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:07:32.282508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:321 - starting polling. Elapsed:0.005 Sep 04 01:07:32.285155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:32.288560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:321 - port information retrieved. Elapsed:0.011 Sep 04 01:07:32.288898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:321 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Sep 04 01:07:32.373777 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-766d707f-5416-4fd5-9115-851d815086d6 tempest-VolumesActionsTest-1122363192 tempest-VolumesActionsTest-1122363192-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:07:31Z,data_plane_status=None,description='',device_id='e1a5a54b-ef31-408d-ac1c-0a78efd9a2b5',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=b8947ab0-23c1-4eaa-93c4-9c1cc435d43e,mac_address=fa:16:3e:c0:8f:10,name='',network_id=7e04f73d-bad8-4860-94c2-08b2d4e17fa9,numa_affinity_policy=,project_id='bcf6c738f8d842f99d2eec3b896c5b47',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(b8947ab0-23c1-4eaa-93c4-9c1cc435d43e),security_group_ids=set([47886e6f-b931-4c89-84ae-31a8725f8d25]),status='DOWN',updated_at=2022-09-04T01:07:31Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:07:32.374168 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-766d707f-5416-4fd5-9115-851d815086d6 tempest-VolumesActionsTest-1122363192 tempest-VolumesActionsTest-1122363192-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (b8947ab0-23c1-4eaa-93c4-9c1cc435d43e), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:32.374625 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-766d707f-5416-4fd5-9115-851d815086d6 tempest-VolumesActionsTest-1122363192 tempest-VolumesActionsTest-1122363192-project] Security group member updated {'47886e6f-b931-4c89-84ae-31a8725f8d25'} Sep 04 01:07:34.278712 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:322 started Sep 04 01:07:34.281219 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5597,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=673000000,duration_sec=663,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:07:34.281786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:07:34.282120 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:322 - starting polling. Elapsed:0.004 Sep 04 01:07:34.284575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:34.287792 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:322 - port information retrieved. Elapsed:0.009 Sep 04 01:07:34.288125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:322 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Sep 04 01:07:35.910970 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-8673b4df-28c9-4cd9-868b-1f51297ebc22 service neutron] Resource Port b8947ab0-23c1-4eaa-93c4-9c1cc435d43e updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=b8947ab0-23c1-4eaa-93c4-9c1cc435d43e,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=b8947ab0-23c1-4eaa-93c4-9c1cc435d43e,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:07:35.912305 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-8673b4df-28c9-4cd9-868b-1f51297ebc22 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (b8947ab0-23c1-4eaa-93c4-9c1cc435d43e), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:36.175546 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-8673b4df-28c9-4cd9-868b-1f51297ebc22 service neutron] Resource Port b8947ab0-23c1-4eaa-93c4-9c1cc435d43e updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=b8947ab0-23c1-4eaa-93c4-9c1cc435d43e,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=b8947ab0-23c1-4eaa-93c4-9c1cc435d43e,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=b8947ab0-23c1-4eaa-93c4-9c1cc435d43e,segment=NetworkSegment(4b145fcd-b870-4624-8e9b-50fe2a121117),segment_id=4b145fcd-b870-4624-8e9b-50fe2a121117)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:07:36.175926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-8673b4df-28c9-4cd9-868b-1f51297ebc22 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (b8947ab0-23c1-4eaa-93c4-9c1cc435d43e), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:36.279369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:323 started Sep 04 01:07:36.281779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5599,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=673000000,duration_sec=665,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:07:36.282357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:07:36.282719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:323 - starting polling. Elapsed:0.003 Sep 04 01:07:36.285053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:36.288777 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:323 - port information retrieved. Elapsed:0.010 Sep 04 01:07:36.289133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:323 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Sep 04 01:07:38.280698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:324 started Sep 04 01:07:38.287995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade559b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=675000000,duration_sec=667,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:07:38.295255 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:07:38.295255 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:324 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 04 01:07:38.594224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-cbb3e060-631a-4a09-b299-ce6ffaabbdb0 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:07:38Z,description='tempest-description--909208191',id=442c2a6c-c343-4c57-b096-17650925c895,is_default=False,name='tempest-securitygroup--1809104088',project_id='287d111f08ac4b05bd5adec9c40d0620',revision_number=1,rules=[SecurityGroupRule(81b03c57-5de6-437b-87f8-8cd2b11fd6a9),SecurityGroupRule(ea3c9c15-91a1-44ab-a2f1-7b7edc4ea5d2)],shared=False,stateful=True,updated_at=2022-09-04T01:07:38Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:07:38.594604 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-cbb3e060-631a-4a09-b299-ce6ffaabbdb0 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (442c2a6c-c343-4c57-b096-17650925c895), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:38.595248 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-cbb3e060-631a-4a09-b299-ce6ffaabbdb0 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:07:38Z,description=,direction='egress',ethertype='IPv6',id=81b03c57-5de6-437b-87f8-8cd2b11fd6a9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='287d111f08ac4b05bd5adec9c40d0620',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=442c2a6c-c343-4c57-b096-17650925c895,updated_at=2022-09-04T01:07:38Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:07:38.595608 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-cbb3e060-631a-4a09-b299-ce6ffaabbdb0 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (81b03c57-5de6-437b-87f8-8cd2b11fd6a9), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:38.595943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-cbb3e060-631a-4a09-b299-ce6ffaabbdb0 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Security group rule updated ['442c2a6c-c343-4c57-b096-17650925c895'] Sep 04 01:07:38.596682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-cbb3e060-631a-4a09-b299-ce6ffaabbdb0 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:07:38Z,description=,direction='egress',ethertype='IPv4',id=ea3c9c15-91a1-44ab-a2f1-7b7edc4ea5d2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='287d111f08ac4b05bd5adec9c40d0620',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=442c2a6c-c343-4c57-b096-17650925c895,updated_at=2022-09-04T01:07:38Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:07:38.597033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-cbb3e060-631a-4a09-b299-ce6ffaabbdb0 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (ea3c9c15-91a1-44ab-a2f1-7b7edc4ea5d2), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:38.597391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-cbb3e060-631a-4a09-b299-ce6ffaabbdb0 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Security group rule updated ['442c2a6c-c343-4c57-b096-17650925c895'] Sep 04 01:07:38.903066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-3e4fbbae-7180-452e-b068-463a9b050990 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:07:38Z,description='',direction='ingress',ethertype='IPv4',id=b41d7505-179a-44cf-8506-73ee1ca8f7ba,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='287d111f08ac4b05bd5adec9c40d0620',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=442c2a6c-c343-4c57-b096-17650925c895,updated_at=2022-09-04T01:07:38Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:07:38.903446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-3e4fbbae-7180-452e-b068-463a9b050990 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (b41d7505-179a-44cf-8506-73ee1ca8f7ba), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:38.903786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-3e4fbbae-7180-452e-b068-463a9b050990 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Security group rule updated ['442c2a6c-c343-4c57-b096-17650925c895'] Sep 04 01:07:39.290924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-134a6439-ce3a-473f-9139-98c65743f753 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:07:39Z,description='',direction='ingress',ethertype='IPv4',id=60ad1c79-9439-49a6-b38a-c3e7e4f9433a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='287d111f08ac4b05bd5adec9c40d0620',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=442c2a6c-c343-4c57-b096-17650925c895,updated_at=2022-09-04T01:07:39Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:07:39.294451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-134a6439-ce3a-473f-9139-98c65743f753 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (60ad1c79-9439-49a6-b38a-c3e7e4f9433a), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:39.294451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-134a6439-ce3a-473f-9139-98c65743f753 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Security group rule updated ['442c2a6c-c343-4c57-b096-17650925c895'] Sep 04 01:07:39.994608 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-07fa8217-1c64-4b9e-9f70-94a69a41425f tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:07:39Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=21a78bab-8f3d-44c4-86b7-043c859432b9,mac_address=fa:16:3e:c2:a0:57,name='',network_id=e8e0564a-d5c9-4fe0-b2d4-538f45096708,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(21a78bab-8f3d-44c4-86b7-043c859432b9),security_group_ids=set([]),status='N/A',updated_at=2022-09-04T01:07:39Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:07:39.995142 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-07fa8217-1c64-4b9e-9f70-94a69a41425f tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (21a78bab-8f3d-44c4-86b7-043c859432b9), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:40.282383 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:325 started Sep 04 01:07:40.287595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade559d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=677000000,duration_sec=669,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:07:40.288328 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:07:40.289123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:325 - starting polling. Elapsed:0.007 Sep 04 01:07:40.292138 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:40.303157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:325 - port information retrieved. Elapsed:0.021 Sep 04 01:07:40.305787 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:325 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.023 Sep 04 01:07:40.424938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-d991eddb-8d1b-482b-b26c-b0600389de88 tempest-ServerRescueNegativeTestJSON-1367456352 tempest-ServerRescueNegativeTestJSON-1367456352-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:07:39Z,data_plane_status=None,description='',device_id='2570ee6c-f335-41bc-8e67-f89a62b28134',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=62f5079a-1d7d-4c5c-bdcd-0af337b6235b,mac_address=fa:16:3e:3f:a7:9f,name='',network_id=b16f22e1-6fb1-440b-98eb-845123e960e6,numa_affinity_policy=,project_id='db72b63281384bd883b04d05bcc35677',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(62f5079a-1d7d-4c5c-bdcd-0af337b6235b),security_group_ids=set([408a6cc9-789d-4d36-bc4c-5052f5aa27fe]),status='DOWN',updated_at=2022-09-04T01:07:40Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:07:40.425772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-d991eddb-8d1b-482b-b26c-b0600389de88 tempest-ServerRescueNegativeTestJSON-1367456352 tempest-ServerRescueNegativeTestJSON-1367456352-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (62f5079a-1d7d-4c5c-bdcd-0af337b6235b), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:40.426658 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-d991eddb-8d1b-482b-b26c-b0600389de88 tempest-ServerRescueNegativeTestJSON-1367456352 tempest-ServerRescueNegativeTestJSON-1367456352-project] Security group member updated {'408a6cc9-789d-4d36-bc4c-5052f5aa27fe'} Sep 04 01:07:40.579438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Resource Port b8947ab0-23c1-4eaa-93c4-9c1cc435d43e updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:07:40.581093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (b8947ab0-23c1-4eaa-93c4-9c1cc435d43e), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:40.868949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-07fa8217-1c64-4b9e-9f70-94a69a41425f tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Resource Port 21a78bab-8f3d-44c4-86b7-043c859432b9 updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': '7c6010d5-511b-41a8-a14f-022e69e0a22e'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:07:40.870001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-07fa8217-1c64-4b9e-9f70-94a69a41425f tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (21a78bab-8f3d-44c4-86b7-043c859432b9), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:41.357844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-5f9a13f7-0049-48d2-843c-413a8425711f service neutron] Resource Port 62f5079a-1d7d-4c5c-bdcd-0af337b6235b updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=62f5079a-1d7d-4c5c-bdcd-0af337b6235b,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=62f5079a-1d7d-4c5c-bdcd-0af337b6235b,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:07:41.358447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-5f9a13f7-0049-48d2-843c-413a8425711f service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (62f5079a-1d7d-4c5c-bdcd-0af337b6235b), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:41.757687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-5f9a13f7-0049-48d2-843c-413a8425711f service neutron] Resource Port 62f5079a-1d7d-4c5c-bdcd-0af337b6235b updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=62f5079a-1d7d-4c5c-bdcd-0af337b6235b,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=62f5079a-1d7d-4c5c-bdcd-0af337b6235b,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=62f5079a-1d7d-4c5c-bdcd-0af337b6235b,segment=NetworkSegment(c1d2cfbc-d3d5-4bd8-9da5-bc22dc7bb131),segment_id=c1d2cfbc-d3d5-4bd8-9da5-bc22dc7bb131)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:07:41.757687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-5f9a13f7-0049-48d2-843c-413a8425711f service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (62f5079a-1d7d-4c5c-bdcd-0af337b6235b), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:42.283692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:326 started Sep 04 01:07:42.288461 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade559f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=678000000,duration_sec=671,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:07:42.293500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:07:42.293500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:326 - starting polling. Elapsed:0.007 Sep 04 01:07:42.296438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:42.302600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:326 - port information retrieved. Elapsed:0.019 Sep 04 01:07:42.303696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:326 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.021 Sep 04 01:07:42.574740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Resource Port b8947ab0-23c1-4eaa-93c4-9c1cc435d43e updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:07:42.581773 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (b8947ab0-23c1-4eaa-93c4-9c1cc435d43e), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:44.289202 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:327 started Sep 04 01:07:44.290052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade55a1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=681000000,duration_sec=673,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:07:44.290925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:07:44.291254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:327 - starting polling. Elapsed:0.007 Sep 04 01:07:44.293735 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:44.297821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:327 - port information retrieved. Elapsed:0.013 Sep 04 01:07:44.297821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:327 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.014 Sep 04 01:07:44.556526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Resource Port fcbc60fd-1785-4f94-9436-a520ec06cdaf updated (revision_number 5->6). Old fields: {'status': 'ACTIVE'} New fields: {'status': 'BUILD'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:07:44.556911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (fcbc60fd-1785-4f94-9436-a520ec06cdaf), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:46.284684 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:328 started Sep 04 01:07:46.287981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade55a3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=679000000,duration_sec=675,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:07:46.288559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:07:46.288896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:328 - starting polling. Elapsed:0.004 Sep 04 01:07:46.291192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:46.294526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:328 - port information retrieved. Elapsed:0.010 Sep 04 01:07:46.294526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:328 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Sep 04 01:07:46.600183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Resource Port 62f5079a-1d7d-4c5c-bdcd-0af337b6235b updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:07:46.600562 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (62f5079a-1d7d-4c5c-bdcd-0af337b6235b), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:46.665426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Resource Port fcbc60fd-1785-4f94-9436-a520ec06cdaf updated (revision_number 6->7). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:07:46.665806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (fcbc60fd-1785-4f94-9436-a520ec06cdaf), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:48.285656 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:329 started Sep 04 01:07:48.293449 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade55a5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=680000000,duration_sec=677,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:07:48.294075 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:07:48.294406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:329 - starting polling. Elapsed:0.009 Sep 04 01:07:48.296644 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:48.299738 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:329 - port information retrieved. Elapsed:0.014 Sep 04 01:07:48.300231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:329 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.015 Sep 04 01:07:49.320865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Resource Port 62f5079a-1d7d-4c5c-bdcd-0af337b6235b updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:07:49.321925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (62f5079a-1d7d-4c5c-bdcd-0af337b6235b), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:50.286164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:330 started Sep 04 01:07:50.289623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade55a7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=681000000,duration_sec=679,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:07:50.290208 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:07:50.290563 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:330 - starting polling. Elapsed:0.005 Sep 04 01:07:50.293179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:50.296329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:330 - port information retrieved. Elapsed:0.010 Sep 04 01:07:50.296657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:330 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 04 01:07:52.286747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:331 started Sep 04 01:07:52.289157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade55a9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=681000000,duration_sec=681,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:07:52.289721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:07:52.290071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:331 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:07:54.287878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:332 started Sep 04 01:07:54.293154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade55ab,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=684000000,duration_sec=683,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:07:54.294342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:07:54.294874 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:332 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 04 01:07:55.201697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-87be0463-b629-4814-9320-b5830d17b716 tempest-VolumesActionsTest-1122363192 tempest-VolumesActionsTest-1122363192-project] Resource Port deleted: b8947ab0-23c1-4eaa-93c4-9c1cc435d43e {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:07:55.202867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-87be0463-b629-4814-9320-b5830d17b716 tempest-VolumesActionsTest-1122363192 tempest-VolumesActionsTest-1122363192-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (b8947ab0-23c1-4eaa-93c4-9c1cc435d43e), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:55.207284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-87be0463-b629-4814-9320-b5830d17b716 tempest-VolumesActionsTest-1122363192 tempest-VolumesActionsTest-1122363192-project] Security group member updated {'47886e6f-b931-4c89-84ae-31a8725f8d25'} Sep 04 01:07:55.730483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c2e98406-b355-4b0e-b988-f8cc9429e8b5 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:07:54Z,data_plane_status=None,description='',device_id='205e4f5b-43ef-494a-a6ad-64f7445e6b59',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=610a3f9e-176f-46b6-82d0-90b3e3651b7b,mac_address=fa:16:3e:6c:17:c0,name='',network_id=d7f39628-666e-4480-8bee-49de183d5e09,numa_affinity_policy=,project_id='287d111f08ac4b05bd5adec9c40d0620',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(610a3f9e-176f-46b6-82d0-90b3e3651b7b),security_group_ids=set([442c2a6c-c343-4c57-b096-17650925c895]),status='DOWN',updated_at=2022-09-04T01:07:55Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:07:55.731649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-c2e98406-b355-4b0e-b988-f8cc9429e8b5 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (610a3f9e-176f-46b6-82d0-90b3e3651b7b), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:55.732122 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-c2e98406-b355-4b0e-b988-f8cc9429e8b5 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Security group member updated {'442c2a6c-c343-4c57-b096-17650925c895'} Sep 04 01:07:56.289069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:333 started Sep 04 01:07:56.292699 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade55ad,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=683000000,duration_sec=685,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:07:56.293332 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:07:56.293667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:333 - starting polling. Elapsed:0.005 Sep 04 01:07:56.296439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:07:56.302176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port b8947ab0-23c1-4eaa-93c4-9c1cc435d43e not present in bridge br-int Sep 04 01:07:56.302768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] net_uuid None not managed by VLAN manager Sep 04 01:07:56.303217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for ['b8947ab0-23c1-4eaa-93c4-9c1cc435d43e'] Sep 04 01:07:56.303711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port b8947ab0-23c1-4eaa-93c4-9c1cc435d43e is not handled by the firewall. {{(pid=107812) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 04 01:07:56.306713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:333 - port information retrieved. Elapsed:0.018 Sep 04 01:07:56.307045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:333 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.018 Sep 04 01:07:58.290178 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:334 started Sep 04 01:07:58.296482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade55af,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=684000000,duration_sec=687,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:07:58.296482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:07:58.296482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:334 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:08:00.291786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:335 started Sep 04 01:08:00.296512 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade55b1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=687000000,duration_sec=689,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:08:00.297717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:08:00.298226 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:335 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 04 01:08:00.949488 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-1382e46a-dff8-4dbd-9fd9-7c813a35c142 service neutron] Resource Port 610a3f9e-176f-46b6-82d0-90b3e3651b7b updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=610a3f9e-176f-46b6-82d0-90b3e3651b7b,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=610a3f9e-176f-46b6-82d0-90b3e3651b7b,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:08:00.952626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-1382e46a-dff8-4dbd-9fd9-7c813a35c142 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (610a3f9e-176f-46b6-82d0-90b3e3651b7b), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:01.663849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-1382e46a-dff8-4dbd-9fd9-7c813a35c142 service neutron] Resource Port 610a3f9e-176f-46b6-82d0-90b3e3651b7b updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=610a3f9e-176f-46b6-82d0-90b3e3651b7b,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=610a3f9e-176f-46b6-82d0-90b3e3651b7b,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=610a3f9e-176f-46b6-82d0-90b3e3651b7b,segment=NetworkSegment(929a573e-75ef-46ab-9889-4a31869bd81c),segment_id=929a573e-75ef-46ab-9889-4a31869bd81c)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:08:01.664435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-1382e46a-dff8-4dbd-9fd9-7c813a35c142 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (610a3f9e-176f-46b6-82d0-90b3e3651b7b), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:02.292662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:336 started Sep 04 01:08:02.295302 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade55b3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=687000000,duration_sec=691,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:08:02.296562 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:08:02.296903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:336 - starting polling. Elapsed:0.004 Sep 04 01:08:02.299220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:02.303108 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:336 - port information retrieved. Elapsed:0.011 Sep 04 01:08:02.303773 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:336 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 04 01:08:04.293647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:337 started Sep 04 01:08:04.297716 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade55b5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=688000000,duration_sec=693,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:08:04.303171 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:08:04.303171 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:337 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 04 01:08:06.295011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:338 started Sep 04 01:08:06.300015 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade55b7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=690000000,duration_sec=695,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:08:06.301948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:08:06.302267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:338 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 04 01:08:08.297878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:339 started Sep 04 01:08:08.300321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade55b9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=692000000,duration_sec=697,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:08:08.301683 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:08:08.302387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:339 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:08:10.299826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:340 started Sep 04 01:08:10.302522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade55bb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=694000000,duration_sec=699,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:08:10.303075 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:08:10.303416 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:340 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:08:11.011021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Resource Port 610a3f9e-176f-46b6-82d0-90b3e3651b7b updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:08:11.011314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (610a3f9e-176f-46b6-82d0-90b3e3651b7b), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:12.301365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:341 started Sep 04 01:08:12.304267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade55bd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=696000000,duration_sec=701,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:08:12.304897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:08:12.305286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:341 - starting polling. Elapsed:0.005 Sep 04 01:08:12.307592 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:12.311339 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:341 - port information retrieved. Elapsed:0.011 Sep 04 01:08:12.311765 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:341 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 04 01:08:13.024391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Resource Port 610a3f9e-176f-46b6-82d0-90b3e3651b7b updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:08:13.024867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (610a3f9e-176f-46b6-82d0-90b3e3651b7b), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:13.264550 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Resource Port fcbc60fd-1785-4f94-9436-a520ec06cdaf updated (revision_number 7->8). Old fields: {'status': 'ACTIVE'} New fields: {'status': 'DOWN'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:08:13.271358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (fcbc60fd-1785-4f94-9436-a520ec06cdaf), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:14.313806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:342 started Sep 04 01:08:14.319091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade55bf,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=708000000,duration_sec=703,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:08:14.319670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:08:14.320000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:342 - starting polling. Elapsed:0.006 Sep 04 01:08:14.322308 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:14.325529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:342 - port information retrieved. Elapsed:0.012 Sep 04 01:08:14.325871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:342 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Sep 04 01:08:14.345190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-034896c2-cc3d-43d6-bd9b-802cbc9a9fe0 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:08:14Z,description='Default security group',id=5fb19e5f-6503-468d-9f3d-f6c3a439aa08,is_default=True,name='default',project_id='a0f43a31c7e549eeb636fcce144cb3bc',revision_number=1,rules=[SecurityGroupRule(4a0b459d-5858-4c26-8c17-6e27b8d5e4bf),SecurityGroupRule(8cffb3a2-c83a-4c16-b56b-4d23fb0ffea6),SecurityGroupRule(9edf8867-0571-4698-93e5-a4b1f269f645),SecurityGroupRule(a72783e6-2940-4e5f-8a93-fda0936e1645)],shared=False,stateful=True,updated_at=2022-09-04T01:08:14Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:08:14.345579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-034896c2-cc3d-43d6-bd9b-802cbc9a9fe0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (5fb19e5f-6503-468d-9f3d-f6c3a439aa08), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:14.346193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-034896c2-cc3d-43d6-bd9b-802cbc9a9fe0 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:08:14Z,description=,direction='egress',ethertype='IPv6',id=4a0b459d-5858-4c26-8c17-6e27b8d5e4bf,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a0f43a31c7e549eeb636fcce144cb3bc',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=5fb19e5f-6503-468d-9f3d-f6c3a439aa08,updated_at=2022-09-04T01:08:14Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:08:14.346716 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-034896c2-cc3d-43d6-bd9b-802cbc9a9fe0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (4a0b459d-5858-4c26-8c17-6e27b8d5e4bf), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:14.347207 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-034896c2-cc3d-43d6-bd9b-802cbc9a9fe0 admin admin] Security group rule updated ['5fb19e5f-6503-468d-9f3d-f6c3a439aa08'] Sep 04 01:08:14.348302 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-034896c2-cc3d-43d6-bd9b-802cbc9a9fe0 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:08:14Z,description=,direction='egress',ethertype='IPv4',id=8cffb3a2-c83a-4c16-b56b-4d23fb0ffea6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a0f43a31c7e549eeb636fcce144cb3bc',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=5fb19e5f-6503-468d-9f3d-f6c3a439aa08,updated_at=2022-09-04T01:08:14Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:08:14.348902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-034896c2-cc3d-43d6-bd9b-802cbc9a9fe0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (8cffb3a2-c83a-4c16-b56b-4d23fb0ffea6), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:14.349404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-034896c2-cc3d-43d6-bd9b-802cbc9a9fe0 admin admin] Security group rule updated ['5fb19e5f-6503-468d-9f3d-f6c3a439aa08'] Sep 04 01:08:14.350280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-034896c2-cc3d-43d6-bd9b-802cbc9a9fe0 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:08:14Z,description=,direction='ingress',ethertype='IPv6',id=9edf8867-0571-4698-93e5-a4b1f269f645,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a0f43a31c7e549eeb636fcce144cb3bc',protocol=,remote_address_group_id=,remote_group_id=5fb19e5f-6503-468d-9f3d-f6c3a439aa08,remote_ip_prefix=,revision_number=0,security_group_id=5fb19e5f-6503-468d-9f3d-f6c3a439aa08,updated_at=2022-09-04T01:08:14Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:08:14.350800 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-034896c2-cc3d-43d6-bd9b-802cbc9a9fe0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (9edf8867-0571-4698-93e5-a4b1f269f645), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:14.351479 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-034896c2-cc3d-43d6-bd9b-802cbc9a9fe0 admin admin] Security group rule updated ['5fb19e5f-6503-468d-9f3d-f6c3a439aa08'] Sep 04 01:08:14.352692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-034896c2-cc3d-43d6-bd9b-802cbc9a9fe0 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:08:14Z,description=,direction='ingress',ethertype='IPv4',id=a72783e6-2940-4e5f-8a93-fda0936e1645,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a0f43a31c7e549eeb636fcce144cb3bc',protocol=,remote_address_group_id=,remote_group_id=5fb19e5f-6503-468d-9f3d-f6c3a439aa08,remote_ip_prefix=,revision_number=0,security_group_id=5fb19e5f-6503-468d-9f3d-f6c3a439aa08,updated_at=2022-09-04T01:08:14Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:08:14.353255 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-034896c2-cc3d-43d6-bd9b-802cbc9a9fe0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (a72783e6-2940-4e5f-8a93-fda0936e1645), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:14.353731 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-034896c2-cc3d-43d6-bd9b-802cbc9a9fe0 admin admin] Security group rule updated ['5fb19e5f-6503-468d-9f3d-f6c3a439aa08'] Sep 04 01:08:14.632041 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-75767e4e-f60e-44bd-8b10-8688c8130402 admin admin] Resource SecurityGroup deleted: 5fb19e5f-6503-468d-9f3d-f6c3a439aa08 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:08:14.632417 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-75767e4e-f60e-44bd-8b10-8688c8130402 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (5fb19e5f-6503-468d-9f3d-f6c3a439aa08), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:14.632878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75767e4e-f60e-44bd-8b10-8688c8130402 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('5fb19e5f-6503-468d-9f3d-f6c3a439aa08',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:08:14.650642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-75767e4e-f60e-44bd-8b10-8688c8130402 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('5fb19e5f-6503-468d-9f3d-f6c3a439aa08',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:08:14.650642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-75767e4e-f60e-44bd-8b10-8688c8130402 admin admin] Resource SecurityGroupRule deleted: 4a0b459d-5858-4c26-8c17-6e27b8d5e4bf {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:08:14.650642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-75767e4e-f60e-44bd-8b10-8688c8130402 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (4a0b459d-5858-4c26-8c17-6e27b8d5e4bf), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:14.650642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-75767e4e-f60e-44bd-8b10-8688c8130402 admin admin] Security group rule updated ['5fb19e5f-6503-468d-9f3d-f6c3a439aa08'] Sep 04 01:08:14.650642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-75767e4e-f60e-44bd-8b10-8688c8130402 admin admin] Resource SecurityGroupRule deleted: 8cffb3a2-c83a-4c16-b56b-4d23fb0ffea6 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:08:14.651009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-75767e4e-f60e-44bd-8b10-8688c8130402 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (8cffb3a2-c83a-4c16-b56b-4d23fb0ffea6), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:14.651009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-75767e4e-f60e-44bd-8b10-8688c8130402 admin admin] Security group rule updated ['5fb19e5f-6503-468d-9f3d-f6c3a439aa08'] Sep 04 01:08:14.651009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-75767e4e-f60e-44bd-8b10-8688c8130402 admin admin] Resource SecurityGroupRule deleted: 9edf8867-0571-4698-93e5-a4b1f269f645 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:08:14.651299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-75767e4e-f60e-44bd-8b10-8688c8130402 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (9edf8867-0571-4698-93e5-a4b1f269f645), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:14.651375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-75767e4e-f60e-44bd-8b10-8688c8130402 admin admin] Security group rule updated ['5fb19e5f-6503-468d-9f3d-f6c3a439aa08'] Sep 04 01:08:14.651769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-75767e4e-f60e-44bd-8b10-8688c8130402 admin admin] Resource SecurityGroupRule deleted: a72783e6-2940-4e5f-8a93-fda0936e1645 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:08:14.652106 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-75767e4e-f60e-44bd-8b10-8688c8130402 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (a72783e6-2940-4e5f-8a93-fda0936e1645), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:14.652420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-75767e4e-f60e-44bd-8b10-8688c8130402 admin admin] Security group rule updated ['5fb19e5f-6503-468d-9f3d-f6c3a439aa08'] Sep 04 01:08:15.396514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-8c415b13-3c64-4941-9268-2549753a096f tempest-VolumesActionsTest-1122363192 tempest-VolumesActionsTest-1122363192-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:08:14Z,data_plane_status=None,description='',device_id='dac07994-d434-4a73-802f-31d1772c646c',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=1f56da33-407e-4160-b5c8-764c4a91f864,mac_address=fa:16:3e:28:5a:dc,name='',network_id=7e04f73d-bad8-4860-94c2-08b2d4e17fa9,numa_affinity_policy=,project_id='bcf6c738f8d842f99d2eec3b896c5b47',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(1f56da33-407e-4160-b5c8-764c4a91f864),security_group_ids=set([47886e6f-b931-4c89-84ae-31a8725f8d25]),status='DOWN',updated_at=2022-09-04T01:08:14Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:08:15.397628 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-8c415b13-3c64-4941-9268-2549753a096f tempest-VolumesActionsTest-1122363192 tempest-VolumesActionsTest-1122363192-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (1f56da33-407e-4160-b5c8-764c4a91f864), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:15.398540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-8c415b13-3c64-4941-9268-2549753a096f tempest-VolumesActionsTest-1122363192 tempest-VolumesActionsTest-1122363192-project] Security group member updated {'47886e6f-b931-4c89-84ae-31a8725f8d25'} Sep 04 01:08:16.314830 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:343 started Sep 04 01:08:16.318455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade55c1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=709000000,duration_sec=705,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:08:16.319052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:08:16.319829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:343 - starting polling. Elapsed:0.005 Sep 04 01:08:16.322552 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:16.326342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:343 - port information retrieved. Elapsed:0.012 Sep 04 01:08:16.326683 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:343 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Sep 04 01:08:18.317329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:344 started Sep 04 01:08:18.323343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade55c3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=711000000,duration_sec=707,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:08:18.324183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:08:18.325832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:344 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 04 01:08:18.572833 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-74f19578-e1a9-4471-b840-bb58d32fd88b service neutron] Resource Port 1f56da33-407e-4160-b5c8-764c4a91f864 updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=1f56da33-407e-4160-b5c8-764c4a91f864,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=1f56da33-407e-4160-b5c8-764c4a91f864,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:08:18.574420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-74f19578-e1a9-4471-b840-bb58d32fd88b service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (1f56da33-407e-4160-b5c8-764c4a91f864), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:18.968119 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-74f19578-e1a9-4471-b840-bb58d32fd88b service neutron] Resource Port 1f56da33-407e-4160-b5c8-764c4a91f864 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=1f56da33-407e-4160-b5c8-764c4a91f864,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=1f56da33-407e-4160-b5c8-764c4a91f864,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=1f56da33-407e-4160-b5c8-764c4a91f864,segment=NetworkSegment(4b145fcd-b870-4624-8e9b-50fe2a121117),segment_id=4b145fcd-b870-4624-8e9b-50fe2a121117)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:08:18.968522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-74f19578-e1a9-4471-b840-bb58d32fd88b service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (1f56da33-407e-4160-b5c8-764c4a91f864), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:19.006235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4d625817-bee7-4462-bad4-37c118de003d tempest-VolumesSnapshotTestJSON-1378097567 tempest-VolumesSnapshotTestJSON-1378097567-project] Resource Port deleted: 449add0b-213e-49af-b0f2-5656f19d796f {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:08:19.006652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4d625817-bee7-4462-bad4-37c118de003d tempest-VolumesSnapshotTestJSON-1378097567 tempest-VolumesSnapshotTestJSON-1378097567-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (449add0b-213e-49af-b0f2-5656f19d796f), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:19.007028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-4d625817-bee7-4462-bad4-37c118de003d tempest-VolumesSnapshotTestJSON-1378097567 tempest-VolumesSnapshotTestJSON-1378097567-project] Security group member updated {'dd251723-c6f9-4e67-b522-e38b91c2bfeb'} Sep 04 01:08:20.318315 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:345 started Sep 04 01:08:20.321190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade55c5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=712000000,duration_sec=709,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:08:20.321790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:08:20.322147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:345 - starting polling. Elapsed:0.004 Sep 04 01:08:20.324449 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:20.326039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 449add0b-213e-49af-b0f2-5656f19d796f not present in bridge br-int Sep 04 01:08:20.326370 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] net_uuid None not managed by VLAN manager Sep 04 01:08:20.326651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for ['449add0b-213e-49af-b0f2-5656f19d796f'] Sep 04 01:08:20.326967 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 449add0b-213e-49af-b0f2-5656f19d796f is not handled by the firewall. {{(pid=107812) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 04 01:08:20.330420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:345 - port information retrieved. Elapsed:0.012 Sep 04 01:08:20.330753 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:345 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Sep 04 01:08:22.327304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:346 started Sep 04 01:08:22.328007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade55c7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=718000000,duration_sec=711,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:08:22.328910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:08:22.329392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:346 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Sep 04 01:08:24.321464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:347 started Sep 04 01:08:24.324166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade55c9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=716000000,duration_sec=713,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:08:24.324749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:08:24.325127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:347 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:08:25.803473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-fc52d710-920b-4c02-8868-a827a4553983 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:08:25Z,description='Default security group',id=ae29aeb7-1392-4c7d-8a0a-247fdb5f4d1e,is_default=True,name='default',project_id='f24e82fca13f44f390d817aa4453e2d3',revision_number=1,rules=[SecurityGroupRule(5e81fc33-794c-4fec-a21f-9917db771cb2),SecurityGroupRule(82ef7196-7b22-4e3f-9c35-d694be4e2f6f),SecurityGroupRule(adbbd267-8553-4440-9d38-daa2cfd9a948),SecurityGroupRule(bdb06a28-f8ee-47aa-93ed-0870f3578406)],shared=False,stateful=True,updated_at=2022-09-04T01:08:25Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:08:25.804049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-fc52d710-920b-4c02-8868-a827a4553983 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (ae29aeb7-1392-4c7d-8a0a-247fdb5f4d1e), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:25.804604 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-fc52d710-920b-4c02-8868-a827a4553983 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:08:25Z,description=,direction='ingress',ethertype='IPv4',id=5e81fc33-794c-4fec-a21f-9917db771cb2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f24e82fca13f44f390d817aa4453e2d3',protocol=,remote_address_group_id=,remote_group_id=ae29aeb7-1392-4c7d-8a0a-247fdb5f4d1e,remote_ip_prefix=,revision_number=0,security_group_id=ae29aeb7-1392-4c7d-8a0a-247fdb5f4d1e,updated_at=2022-09-04T01:08:25Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:08:25.804973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-fc52d710-920b-4c02-8868-a827a4553983 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (5e81fc33-794c-4fec-a21f-9917db771cb2), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:25.805402 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-fc52d710-920b-4c02-8868-a827a4553983 admin admin] Security group rule updated ['ae29aeb7-1392-4c7d-8a0a-247fdb5f4d1e'] Sep 04 01:08:25.806141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-fc52d710-920b-4c02-8868-a827a4553983 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:08:25Z,description=,direction='egress',ethertype='IPv4',id=82ef7196-7b22-4e3f-9c35-d694be4e2f6f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f24e82fca13f44f390d817aa4453e2d3',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ae29aeb7-1392-4c7d-8a0a-247fdb5f4d1e,updated_at=2022-09-04T01:08:25Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:08:25.806499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-fc52d710-920b-4c02-8868-a827a4553983 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (82ef7196-7b22-4e3f-9c35-d694be4e2f6f), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:25.806828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-fc52d710-920b-4c02-8868-a827a4553983 admin admin] Security group rule updated ['ae29aeb7-1392-4c7d-8a0a-247fdb5f4d1e'] Sep 04 01:08:25.807530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-fc52d710-920b-4c02-8868-a827a4553983 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:08:25Z,description=,direction='ingress',ethertype='IPv6',id=adbbd267-8553-4440-9d38-daa2cfd9a948,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f24e82fca13f44f390d817aa4453e2d3',protocol=,remote_address_group_id=,remote_group_id=ae29aeb7-1392-4c7d-8a0a-247fdb5f4d1e,remote_ip_prefix=,revision_number=0,security_group_id=ae29aeb7-1392-4c7d-8a0a-247fdb5f4d1e,updated_at=2022-09-04T01:08:25Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:08:25.807940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-fc52d710-920b-4c02-8868-a827a4553983 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (adbbd267-8553-4440-9d38-daa2cfd9a948), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:25.808272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-fc52d710-920b-4c02-8868-a827a4553983 admin admin] Security group rule updated ['ae29aeb7-1392-4c7d-8a0a-247fdb5f4d1e'] Sep 04 01:08:25.808995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-fc52d710-920b-4c02-8868-a827a4553983 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:08:25Z,description=,direction='egress',ethertype='IPv6',id=bdb06a28-f8ee-47aa-93ed-0870f3578406,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f24e82fca13f44f390d817aa4453e2d3',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ae29aeb7-1392-4c7d-8a0a-247fdb5f4d1e,updated_at=2022-09-04T01:08:25Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:08:25.809375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-fc52d710-920b-4c02-8868-a827a4553983 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (bdb06a28-f8ee-47aa-93ed-0870f3578406), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:25.809700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-fc52d710-920b-4c02-8868-a827a4553983 admin admin] Security group rule updated ['ae29aeb7-1392-4c7d-8a0a-247fdb5f4d1e'] Sep 04 01:08:26.042566 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-ecaae181-2dff-47df-af19-bb1ca1f965fd admin admin] Resource SecurityGroup deleted: ae29aeb7-1392-4c7d-8a0a-247fdb5f4d1e {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:08:26.042953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-ecaae181-2dff-47df-af19-bb1ca1f965fd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (ae29aeb7-1392-4c7d-8a0a-247fdb5f4d1e), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:26.043448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ecaae181-2dff-47df-af19-bb1ca1f965fd admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('ae29aeb7-1392-4c7d-8a0a-247fdb5f4d1e',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:08:26.057542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-ecaae181-2dff-47df-af19-bb1ca1f965fd admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('ae29aeb7-1392-4c7d-8a0a-247fdb5f4d1e',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:08:26.058055 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-ecaae181-2dff-47df-af19-bb1ca1f965fd admin admin] Resource SecurityGroupRule deleted: 5e81fc33-794c-4fec-a21f-9917db771cb2 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:08:26.058429 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-ecaae181-2dff-47df-af19-bb1ca1f965fd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (5e81fc33-794c-4fec-a21f-9917db771cb2), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:26.058771 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-ecaae181-2dff-47df-af19-bb1ca1f965fd admin admin] Security group rule updated ['ae29aeb7-1392-4c7d-8a0a-247fdb5f4d1e'] Sep 04 01:08:26.059236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-ecaae181-2dff-47df-af19-bb1ca1f965fd admin admin] Resource SecurityGroupRule deleted: 82ef7196-7b22-4e3f-9c35-d694be4e2f6f {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:08:26.059586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-ecaae181-2dff-47df-af19-bb1ca1f965fd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (82ef7196-7b22-4e3f-9c35-d694be4e2f6f), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:26.059907 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-ecaae181-2dff-47df-af19-bb1ca1f965fd admin admin] Security group rule updated ['ae29aeb7-1392-4c7d-8a0a-247fdb5f4d1e'] Sep 04 01:08:26.060323 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-ecaae181-2dff-47df-af19-bb1ca1f965fd admin admin] Resource SecurityGroupRule deleted: adbbd267-8553-4440-9d38-daa2cfd9a948 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:08:26.060666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-ecaae181-2dff-47df-af19-bb1ca1f965fd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (adbbd267-8553-4440-9d38-daa2cfd9a948), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:26.061014 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-ecaae181-2dff-47df-af19-bb1ca1f965fd admin admin] Security group rule updated ['ae29aeb7-1392-4c7d-8a0a-247fdb5f4d1e'] Sep 04 01:08:26.061457 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-ecaae181-2dff-47df-af19-bb1ca1f965fd admin admin] Resource SecurityGroupRule deleted: bdb06a28-f8ee-47aa-93ed-0870f3578406 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:08:26.061822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-ecaae181-2dff-47df-af19-bb1ca1f965fd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (bdb06a28-f8ee-47aa-93ed-0870f3578406), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:26.062193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-ecaae181-2dff-47df-af19-bb1ca1f965fd admin admin] Security group rule updated ['ae29aeb7-1392-4c7d-8a0a-247fdb5f4d1e'] Sep 04 01:08:26.322262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:348 started Sep 04 01:08:26.325451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade55cb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=717000000,duration_sec=715,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:08:26.326009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:08:26.326357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:348 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:08:27.285331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Resource Port 1f56da33-407e-4160-b5c8-764c4a91f864 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:08:27.285911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (1f56da33-407e-4160-b5c8-764c4a91f864), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:27.405505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-072b13e2-6d88-4abb-bd92-4840768c7920 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:08:27Z,description='Default security group',id=a8764ee1-c7fb-4fc4-9d1d-0fd46b8560a9,is_default=True,name='default',project_id='735896cd6b3b4c448dd94b3bf7577cb8',revision_number=1,rules=[SecurityGroupRule(11828f56-dd52-4a3b-94da-a0bef8472d57),SecurityGroupRule(795d89de-1dd7-4055-9f1b-0e71966260be),SecurityGroupRule(e5f5c91f-5e9f-4fb4-99ed-f28b1eaa1e1f),SecurityGroupRule(f7e999f1-25f7-494d-addb-bc36db1e03a3)],shared=False,stateful=True,updated_at=2022-09-04T01:08:27Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:08:27.406195 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-072b13e2-6d88-4abb-bd92-4840768c7920 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (a8764ee1-c7fb-4fc4-9d1d-0fd46b8560a9), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:27.406826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-072b13e2-6d88-4abb-bd92-4840768c7920 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:08:27Z,description=,direction='ingress',ethertype='IPv6',id=11828f56-dd52-4a3b-94da-a0bef8472d57,normalized_cidr=None,port_range_max=,port_range_min=,project_id='735896cd6b3b4c448dd94b3bf7577cb8',protocol=,remote_address_group_id=,remote_group_id=a8764ee1-c7fb-4fc4-9d1d-0fd46b8560a9,remote_ip_prefix=,revision_number=0,security_group_id=a8764ee1-c7fb-4fc4-9d1d-0fd46b8560a9,updated_at=2022-09-04T01:08:27Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:08:27.407192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-072b13e2-6d88-4abb-bd92-4840768c7920 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (11828f56-dd52-4a3b-94da-a0bef8472d57), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:27.407552 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-072b13e2-6d88-4abb-bd92-4840768c7920 admin admin] Security group rule updated ['a8764ee1-c7fb-4fc4-9d1d-0fd46b8560a9'] Sep 04 01:08:27.408253 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-072b13e2-6d88-4abb-bd92-4840768c7920 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:08:27Z,description=,direction='egress',ethertype='IPv6',id=795d89de-1dd7-4055-9f1b-0e71966260be,normalized_cidr=None,port_range_max=,port_range_min=,project_id='735896cd6b3b4c448dd94b3bf7577cb8',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=a8764ee1-c7fb-4fc4-9d1d-0fd46b8560a9,updated_at=2022-09-04T01:08:27Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:08:27.408600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-072b13e2-6d88-4abb-bd92-4840768c7920 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (795d89de-1dd7-4055-9f1b-0e71966260be), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:27.408923 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-072b13e2-6d88-4abb-bd92-4840768c7920 admin admin] Security group rule updated ['a8764ee1-c7fb-4fc4-9d1d-0fd46b8560a9'] Sep 04 01:08:27.409733 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-072b13e2-6d88-4abb-bd92-4840768c7920 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:08:27Z,description=,direction='egress',ethertype='IPv4',id=e5f5c91f-5e9f-4fb4-99ed-f28b1eaa1e1f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='735896cd6b3b4c448dd94b3bf7577cb8',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=a8764ee1-c7fb-4fc4-9d1d-0fd46b8560a9,updated_at=2022-09-04T01:08:27Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:08:27.410084 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-072b13e2-6d88-4abb-bd92-4840768c7920 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (e5f5c91f-5e9f-4fb4-99ed-f28b1eaa1e1f), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:27.410406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-072b13e2-6d88-4abb-bd92-4840768c7920 admin admin] Security group rule updated ['a8764ee1-c7fb-4fc4-9d1d-0fd46b8560a9'] Sep 04 01:08:27.411089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-072b13e2-6d88-4abb-bd92-4840768c7920 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:08:27Z,description=,direction='ingress',ethertype='IPv4',id=f7e999f1-25f7-494d-addb-bc36db1e03a3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='735896cd6b3b4c448dd94b3bf7577cb8',protocol=,remote_address_group_id=,remote_group_id=a8764ee1-c7fb-4fc4-9d1d-0fd46b8560a9,remote_ip_prefix=,revision_number=0,security_group_id=a8764ee1-c7fb-4fc4-9d1d-0fd46b8560a9,updated_at=2022-09-04T01:08:27Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:08:27.411485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-072b13e2-6d88-4abb-bd92-4840768c7920 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (f7e999f1-25f7-494d-addb-bc36db1e03a3), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:27.411812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-072b13e2-6d88-4abb-bd92-4840768c7920 admin admin] Security group rule updated ['a8764ee1-c7fb-4fc4-9d1d-0fd46b8560a9'] Sep 04 01:08:27.600169 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-072b13e2-6d88-4abb-bd92-4840768c7920 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-04T01:08:27Z,description='',dns_domain=None,id=a4020194-c9cd-46d3-9c56-5d8c215c248f,mtu=1500,name='tempest-TestShelveInstance-1866404127-network',project_id='735896cd6b3b4c448dd94b3bf7577cb8',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(a4020194-c9cd-46d3-9c56-5d8c215c248f),segments=[NetworkSegment(7f3c23b7-4619-4de8-89fe-789a39101159)],shared=False,status='ACTIVE',updated_at=2022-09-04T01:08:27Z,vlan_transparent=) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:08:27.601654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-072b13e2-6d88-4abb-bd92-4840768c7920 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533'] for Network (a4020194-c9cd-46d3-9c56-5d8c215c248f), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:27.672570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager [None req-072b13e2-6d88-4abb-bd92-4840768c7920 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network a4020194-c9cd-46d3-9c56-5d8c215c248f with segmentation id not found. Sep 04 01:08:27.672570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 04 01:08:27.672570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 04 01:08:27.672570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 04 01:08:27.672570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 04 01:08:27.672570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 04 01:08:27.672570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 04 01:08:27.672570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 04 01:08:27.672570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 04 01:08:27.672570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 04 01:08:27.672570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 04 01:08:27.672570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 04 01:08:27.672570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 04 01:08:27.673591 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 04 01:08:27.673591 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 04 01:08:27.673591 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 04 01:08:27.673591 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network a4020194-c9cd-46d3-9c56-5d8c215c248f with segmentation id not found. Sep 04 01:08:27.673591 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager Sep 04 01:08:27.987787 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-f226491a-7e8a-4341-8055-045aa7c4ea55 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(d42c986b-38dd-422c-aa22-054fa4efa5b2)],cidr=172.20.0.0/28,created_at=2022-09-04T01:08:27Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=7ab2e9dc-328d-4fbf-b70b-2170fdc1a3db,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-TestShelveInstance-1866404127-subnet',network_id=a4020194-c9cd-46d3-9c56-5d8c215c248f,project_id='735896cd6b3b4c448dd94b3bf7577cb8',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-04T01:08:27Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:08:27.988172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-f226491a-7e8a-4341-8055-045aa7c4ea55 admin admin] Publish callbacks [] for Subnet (7ab2e9dc-328d-4fbf-b70b-2170fdc1a3db), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:28.322780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:349 started Sep 04 01:08:28.325607 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade55cd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=717000000,duration_sec=717,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:08:28.326278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:08:28.326740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:349 - starting polling. Elapsed:0.004 Sep 04 01:08:28.334721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:28.336765 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:349 - port information retrieved. Elapsed:0.013 Sep 04 01:08:28.337357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:349 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.015 Sep 04 01:08:28.922577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-2695818f-d9d7-4551-97bc-08d39de0af92 None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:08:28Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-a4020194-c9cd-46d3-9c56-5d8c215c248f',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=68e4df44-e581-4fa1-922b-1b78021d5d7b,mac_address=fa:16:3e:8b:df:40,name='',network_id=a4020194-c9cd-46d3-9c56-5d8c215c248f,numa_affinity_policy=,project_id='735896cd6b3b4c448dd94b3bf7577cb8',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(68e4df44-e581-4fa1-922b-1b78021d5d7b),security_group_ids=set([]),status='DOWN',updated_at=2022-09-04T01:08:28Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:08:28.924427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-2695818f-d9d7-4551-97bc-08d39de0af92 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (68e4df44-e581-4fa1-922b-1b78021d5d7b), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:29.547398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["38bd789f-d27a-428e-a16e-7d526d7237d4","insert","tap68e4df44-e5",["set",[]],["map",[["attached-mac","fa:16:3e:8b:df:40"],["iface-id","68e4df44-e581-4fa1-922b-1b78021d5d7b"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:08:29.573941 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["38bd789f-d27a-428e-a16e-7d526d7237d4","old",null,["set",[]],null],["","new","tap68e4df44-e5",21,["map",[["attached-mac","fa:16:3e:8b:df:40"],["iface-id","68e4df44-e581-4fa1-922b-1b78021d5d7b"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:08:29.603353 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-2695818f-d9d7-4551-97bc-08d39de0af92 None None] Resource Port 68e4df44-e581-4fa1-922b-1b78021d5d7b updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=68e4df44-e581-4fa1-922b-1b78021d5d7b,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=68e4df44-e581-4fa1-922b-1b78021d5d7b,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=68e4df44-e581-4fa1-922b-1b78021d5d7b,segment=NetworkSegment(7f3c23b7-4619-4de8-89fe-789a39101159),segment_id=7f3c23b7-4619-4de8-89fe-789a39101159)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:08:29.603904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-2695818f-d9d7-4551-97bc-08d39de0af92 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (68e4df44-e581-4fa1-922b-1b78021d5d7b), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:29.905500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-82edcd43-3903-4b76-aa1e-22c208c83c07 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:08:29Z,data_plane_status=None,description='',device_id='f0ee559e-077c-4e58-ab73-0bb5ccdf6fe7',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=e507db86-47c3-4953-96bb-c5e552b4f602,mac_address=fa:16:3e:14:e3:97,name='',network_id=e8e0564a-d5c9-4fe0-b2d4-538f45096708,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(e507db86-47c3-4953-96bb-c5e552b4f602),security_group_ids=set([]),status='DOWN',updated_at=2022-09-04T01:08:29Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:08:29.905930 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-82edcd43-3903-4b76-aa1e-22c208c83c07 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (e507db86-47c3-4953-96bb-c5e552b4f602), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:30.324951 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:350 started Sep 04 01:08:30.330126 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade55cf,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=719000000,duration_sec=719,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:08:30.330737 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:08:30.331272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:350 - starting polling. Elapsed:0.007 Sep 04 01:08:30.334132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:30.343234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:350 - port information retrieved. Elapsed:0.018 Sep 04 01:08:30.343826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Starting to process devices in:{'current': {'c2f724af-5dbd-4d91-83cd-c5152b744599', 'a6788698-0516-4d8a-8fe8-2add6e7f6e94', 'f38c3884-111a-49d9-bcf1-6a965ff5e110', '3fa24970-97a7-4f46-ac55-0b24323fa402', '0a1a9f7e-73de-4620-ae03-4b1d50d7f706', '3045b911-01c5-4fc3-8e89-ac2d9cea12a8', '89aa06b4-bbf1-40c2-bb48-500c3aecdf48', '68e4df44-e581-4fa1-922b-1b78021d5d7b', '6771cbc4-3e4b-419f-b87f-2db662f6e010', '4ed942cd-0f45-4d77-a66d-1d6c875877dc', 'f45b435f-0f64-41fe-a6ec-36683da765f9', '53e7a39c-e9ce-45c4-84af-632f2aac70ae', '378bbdd4-3077-4657-8055-fdc0a7600948', '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', 'dd44c60a-dd0f-4ff2-85ae-8c012af89cf9', '1cf499fb-10a0-4af2-afec-5f610dc85da6', 'ca102ce7-433c-4029-aabf-33d944165ff1'}, 'added': {'68e4df44-e581-4fa1-922b-1b78021d5d7b'}, 'removed': set(), 'updated': {'68e4df44-e581-4fa1-922b-1b78021d5d7b'}, 're_added': set()} {{(pid=107812) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 04 01:08:30.344635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': '68e4df44-e581-4fa1-922b-1b78021d5d7b', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-a4020194-c9cd-46d3-9c56-5d8c215c248f', 'network_id': 'a4020194-c9cd-46d3-9c56-5d8c215c248f', 'port_id': '68e4df44-e581-4fa1-922b-1b78021d5d7b', 'mac_address': 'fa:16:3e:8b:df:40', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 176, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '7ab2e9dc-328d-4fbf-b70b-2170fdc1a3db', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 01:08:30.348771 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: 68e4df44-e581-4fa1-922b-1b78021d5d7b {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:08:30.349441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 68e4df44-e581-4fa1-922b-1b78021d5d7b updated. Details: {'device': '68e4df44-e581-4fa1-922b-1b78021d5d7b', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-a4020194-c9cd-46d3-9c56-5d8c215c248f', 'network_id': 'a4020194-c9cd-46d3-9c56-5d8c215c248f', 'port_id': '68e4df44-e581-4fa1-922b-1b78021d5d7b', 'mac_address': 'fa:16:3e:8b:df:40', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 176, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '7ab2e9dc-328d-4fbf-b70b-2170fdc1a3db', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Sep 04 01:08:30.350035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Assigning 9 as local vlan for net-id=a4020194-c9cd-46d3-9c56-5d8c215c248f, seg-id=176 Sep 04 01:08:30.356555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0x1fd38bff,OFPFlowMod(buffer_id=4294967295,command=0,cookie=6561907047025962751,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4272), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4105}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:08:30.370365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0xeade55d1,OFPFlowMod(buffer_id=4294967295,command=0,cookie=6887031442322345889,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4105)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4272}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:08:30.371932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap68e4df44-e5, col_values=(('tag', 9),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:08:30.372627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap68e4df44-e5, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:08:30.373399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap68e4df44-e5, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:08:30.391473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap68e4df44-e5, col_values=(('other_config', {'net_uuid': 'a4020194-c9cd-46d3-9c56-5d8c215c248f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '9', 'segmentation_id': '176'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:08:30.417614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade55d3,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 21}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:08:30.418218 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:350 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 17 devices currently available. Time elapsed: 0.074 Sep 04 01:08:30.418769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Preparing device filters for 1 new devices {{(pid=107812) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 04 01:08:30.419278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Preparing filters for devices {'68e4df44-e581-4fa1-922b-1b78021d5d7b'} Sep 04 01:08:30.420692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information for ports dict_keys([]) {{(pid=107812) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 04 01:08:30.424212 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information {{(pid=107812) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 04 01:08:30.438245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 2 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:08:30.454588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Resource Port 1f56da33-407e-4160-b5c8-764c4a91f864 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:08:30.455367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (1f56da33-407e-4160-b5c8-764c4a91f864), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:30.522416 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5bc08bf-ed06-43d7-9ec7-06d8789ae588]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:08:30.523308 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:350 - agent port security group processed in 0.179 Sep 04 01:08:30.524245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for 68e4df44-e581-4fa1-922b-1b78021d5d7b to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 01:08:31.689358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Configuration for devices up ['68e4df44-e581-4fa1-922b-1b78021d5d7b'] and devices down [] completed. Sep 04 01:08:31.691370 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:350 - ports processed. Elapsed:1.367 Sep 04 01:08:31.692002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:350 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:1.367 Sep 04 01:08:31.753574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Resource Port 68e4df44-e581-4fa1-922b-1b78021d5d7b updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:08:31.754297 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (68e4df44-e581-4fa1-922b-1b78021d5d7b), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:32.326492 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:351 started Sep 04 01:08:32.330804 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade55d5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=722000000,duration_sec=721,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:08:32.331796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:08:32.332189 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:351 - starting polling. Elapsed:0.006 Sep 04 01:08:32.334626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:32.339418 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:351 - port information retrieved. Elapsed:0.012 Sep 04 01:08:32.340253 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Starting to process devices in:{'current': {'c2f724af-5dbd-4d91-83cd-c5152b744599', 'a6788698-0516-4d8a-8fe8-2add6e7f6e94', 'f38c3884-111a-49d9-bcf1-6a965ff5e110', '3fa24970-97a7-4f46-ac55-0b24323fa402', '0a1a9f7e-73de-4620-ae03-4b1d50d7f706', '3045b911-01c5-4fc3-8e89-ac2d9cea12a8', '89aa06b4-bbf1-40c2-bb48-500c3aecdf48', '68e4df44-e581-4fa1-922b-1b78021d5d7b', '6771cbc4-3e4b-419f-b87f-2db662f6e010', '4ed942cd-0f45-4d77-a66d-1d6c875877dc', 'f45b435f-0f64-41fe-a6ec-36683da765f9', '53e7a39c-e9ce-45c4-84af-632f2aac70ae', '378bbdd4-3077-4657-8055-fdc0a7600948', '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', 'dd44c60a-dd0f-4ff2-85ae-8c012af89cf9', '1cf499fb-10a0-4af2-afec-5f610dc85da6', 'ca102ce7-433c-4029-aabf-33d944165ff1'}, 'added': set(), 'removed': set(), 'updated': {'68e4df44-e581-4fa1-922b-1b78021d5d7b'}, 're_added': set()} {{(pid=107812) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 04 01:08:32.344477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': '68e4df44-e581-4fa1-922b-1b78021d5d7b', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-a4020194-c9cd-46d3-9c56-5d8c215c248f', 'network_id': 'a4020194-c9cd-46d3-9c56-5d8c215c248f', 'port_id': '68e4df44-e581-4fa1-922b-1b78021d5d7b', 'mac_address': 'fa:16:3e:8b:df:40', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 176, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '7ab2e9dc-328d-4fbf-b70b-2170fdc1a3db', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 01:08:32.352704 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: 68e4df44-e581-4fa1-922b-1b78021d5d7b {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:08:32.353448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 68e4df44-e581-4fa1-922b-1b78021d5d7b updated. Details: {'device': '68e4df44-e581-4fa1-922b-1b78021d5d7b', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-a4020194-c9cd-46d3-9c56-5d8c215c248f', 'network_id': 'a4020194-c9cd-46d3-9c56-5d8c215c248f', 'port_id': '68e4df44-e581-4fa1-922b-1b78021d5d7b', 'mac_address': 'fa:16:3e:8b:df:40', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 176, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '7ab2e9dc-328d-4fbf-b70b-2170fdc1a3db', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 9} Sep 04 01:08:32.358685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap68e4df44-e5, col_values=(('tag', 9),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:08:32.358685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap68e4df44-e5, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:08:32.358685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap68e4df44-e5, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:08:32.358685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 01:08:32.358685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap68e4df44-e5, col_values=(('other_config', {'net_uuid': 'a4020194-c9cd-46d3-9c56-5d8c215c248f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '176', 'tag': '9'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:08:32.358685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 01:08:32.368857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade55d7,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 21}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:08:32.369365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:351 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 17 devices currently available. Time elapsed: 0.028 Sep 04 01:08:32.369732 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Refreshing firewall for 1 devices {{(pid=107812) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 04 01:08:32.370027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Refresh firewall rules Sep 04 01:08:32.371180 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information for ports dict_keys([]) {{(pid=107812) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 04 01:08:32.371467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information {{(pid=107812) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 04 01:08:32.376063 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 2 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:08:32.449641 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-f8643169-d07b-4b2f-a4f6-9010e004d3df None None] Resource Port e507db86-47c3-4953-96bb-c5e552b4f602 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=e507db86-47c3-4953-96bb-c5e552b4f602,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=e507db86-47c3-4953-96bb-c5e552b4f602,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:08:32.452465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-f8643169-d07b-4b2f-a4f6-9010e004d3df None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (e507db86-47c3-4953-96bb-c5e552b4f602), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:32.455552 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f67a069-dc71-41b4-8a74-285710a7fd53]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:08:32.457810 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:351 - agent port security group processed in 0.115 Sep 04 01:08:32.458607 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for 68e4df44-e581-4fa1-922b-1b78021d5d7b to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 01:08:32.747157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-f8643169-d07b-4b2f-a4f6-9010e004d3df None None] Resource Port e507db86-47c3-4953-96bb-c5e552b4f602 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=e507db86-47c3-4953-96bb-c5e552b4f602,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=e507db86-47c3-4953-96bb-c5e552b4f602,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=e507db86-47c3-4953-96bb-c5e552b4f602,segment=NetworkSegment(c26850af-ca47-4ea8-9a33-a34f3381800e),segment_id=c26850af-ca47-4ea8-9a33-a34f3381800e)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:08:32.748645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-f8643169-d07b-4b2f-a4f6-9010e004d3df None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (e507db86-47c3-4953-96bb-c5e552b4f602), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:33.011060 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Configuration for devices up ['68e4df44-e581-4fa1-922b-1b78021d5d7b'] and devices down [] completed. Sep 04 01:08:33.011498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:351 - ports processed. Elapsed:0.685 Sep 04 01:08:33.011898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:351 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.686 Sep 04 01:08:33.408046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-200d823b-a93f-4478-896b-fee914de6602 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:08:32Z,data_plane_status=None,description='',device_id='f0ee559e-077c-4e58-ab73-0bb5ccdf6fe7',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=9db3ca9e-27d3-4852-b8c6-3fc745d2d055,mac_address=fa:16:3e:50:56:80,name='',network_id=a4020194-c9cd-46d3-9c56-5d8c215c248f,numa_affinity_policy=,project_id='735896cd6b3b4c448dd94b3bf7577cb8',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(9db3ca9e-27d3-4852-b8c6-3fc745d2d055),security_group_ids=set([]),status='DOWN',updated_at=2022-09-04T01:08:32Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:08:33.408748 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-200d823b-a93f-4478-896b-fee914de6602 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (9db3ca9e-27d3-4852-b8c6-3fc745d2d055), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:33.630941 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["ab80ce52-db12-4072-840d-a8de32f0af16","insert","qg-e507db86-47",["set",[]],["map",[["attached-mac","fa:16:3e:14:e3:97"],["iface-id","e507db86-47c3-4953-96bb-c5e552b4f602"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:08:33.648148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["ab80ce52-db12-4072-840d-a8de32f0af16","old",null,["set",[]],null],["","new","qg-e507db86-47",22,["map",[["attached-mac","fa:16:3e:14:e3:97"],["iface-id","e507db86-47c3-4953-96bb-c5e552b4f602"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:08:34.295449 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-200d823b-a93f-4478-896b-fee914de6602 admin admin] Received resource Port update without any changes: 9db3ca9e-27d3-4852-b8c6-3fc745d2d055 {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:181}} Sep 04 01:08:34.327000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:352 started Sep 04 01:08:34.330167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade55d9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=721000000,duration_sec=723,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:08:34.331658 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:08:34.332451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:352 - starting polling. Elapsed:0.006 Sep 04 01:08:34.336930 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:34.341282 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:352 - port information retrieved. Elapsed:0.014 Sep 04 01:08:34.342442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Starting to process devices in:{'current': {'c2f724af-5dbd-4d91-83cd-c5152b744599', 'a6788698-0516-4d8a-8fe8-2add6e7f6e94', 'f38c3884-111a-49d9-bcf1-6a965ff5e110', '3fa24970-97a7-4f46-ac55-0b24323fa402', '0a1a9f7e-73de-4620-ae03-4b1d50d7f706', '3045b911-01c5-4fc3-8e89-ac2d9cea12a8', '89aa06b4-bbf1-40c2-bb48-500c3aecdf48', '68e4df44-e581-4fa1-922b-1b78021d5d7b', '6771cbc4-3e4b-419f-b87f-2db662f6e010', 'e507db86-47c3-4953-96bb-c5e552b4f602', '4ed942cd-0f45-4d77-a66d-1d6c875877dc', 'f45b435f-0f64-41fe-a6ec-36683da765f9', '53e7a39c-e9ce-45c4-84af-632f2aac70ae', '378bbdd4-3077-4657-8055-fdc0a7600948', '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', 'dd44c60a-dd0f-4ff2-85ae-8c012af89cf9', '1cf499fb-10a0-4af2-afec-5f610dc85da6', 'ca102ce7-433c-4029-aabf-33d944165ff1'}, 'added': {'e507db86-47c3-4953-96bb-c5e552b4f602'}, 'removed': set(), 'updated': {'e507db86-47c3-4953-96bb-c5e552b4f602'}, 're_added': set()} {{(pid=107812) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 04 01:08:34.343666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': 'e507db86-47c3-4953-96bb-c5e552b4f602', 'device_id': 'f0ee559e-077c-4e58-ab73-0bb5ccdf6fe7', 'network_id': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'port_id': 'e507db86-47c3-4953-96bb-c5e552b4f602', 'mac_address': 'fa:16:3e:14:e3:97', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '2b17f894-c374-4207-90ad-14f794c86627', 'ip_address': '172.37.7.41'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 01:08:34.362668 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: e507db86-47c3-4953-96bb-c5e552b4f602 {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:08:34.363098 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port e507db86-47c3-4953-96bb-c5e552b4f602 updated. Details: {'device': 'e507db86-47c3-4953-96bb-c5e552b4f602', 'device_id': 'f0ee559e-077c-4e58-ab73-0bb5ccdf6fe7', 'network_id': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'port_id': 'e507db86-47c3-4953-96bb-c5e552b4f602', 'mac_address': 'fa:16:3e:14:e3:97', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '2b17f894-c374-4207-90ad-14f794c86627', 'ip_address': '172.37.7.41'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 04 01:08:34.364522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-e507db86-47, col_values=(('tag', 2),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:08:34.365018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-e507db86-47, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:08:34.370140 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-e507db86-47, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:08:34.375903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-e507db86-47, col_values=(('other_config', {'net_uuid': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:08:34.391185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade55db,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 22}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:08:34.391975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:352 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 18 devices currently available. Time elapsed: 0.049 Sep 04 01:08:34.392084 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Preparing device filters for 1 new devices {{(pid=107812) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 04 01:08:34.392365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Preparing filters for devices {'e507db86-47c3-4953-96bb-c5e552b4f602'} Sep 04 01:08:34.399188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information for ports dict_keys([]) {{(pid=107812) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 04 01:08:34.399841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information {{(pid=107812) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 04 01:08:34.404350 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 2 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:08:34.520628 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[72994095-ad17-4dd7-8abe-7881db1c6eda]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:08:34.521559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:352 - agent port security group processed in 0.179 Sep 04 01:08:34.522498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for e507db86-47c3-4953-96bb-c5e552b4f602 to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 01:08:34.952159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Configuration for devices up ['e507db86-47c3-4953-96bb-c5e552b4f602'] and devices down [] completed. Sep 04 01:08:34.952816 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:352 - ports processed. Elapsed:0.626 Sep 04 01:08:34.954874 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:352 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.627 Sep 04 01:08:35.022048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Resource Port e507db86-47c3-4953-96bb-c5e552b4f602 updated (revision_number 3->4). Old fields: {'status': 'DOWN', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=e507db86-47c3-4953-96bb-c5e552b4f602,segment=NetworkSegment(c26850af-ca47-4ea8-9a33-a34f3381800e),segment_id=c26850af-ca47-4ea8-9a33-a34f3381800e)]} New fields: {'status': 'ACTIVE', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=e507db86-47c3-4953-96bb-c5e552b4f602,segment=NetworkSegment(c26850af-ca47-4ea8-9a33-a34f3381800e),segment_id=c26850af-ca47-4ea8-9a33-a34f3381800e)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:08:35.022437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (e507db86-47c3-4953-96bb-c5e552b4f602), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:36.329332 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:353 started Sep 04 01:08:36.332061 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade55dd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=723000000,duration_sec=725,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:08:36.333217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:08:36.333840 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:353 - starting polling. Elapsed:0.005 Sep 04 01:08:36.336416 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:36.339731 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:353 - port information retrieved. Elapsed:0.011 Sep 04 01:08:36.340072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Starting to process devices in:{'current': {'c2f724af-5dbd-4d91-83cd-c5152b744599', 'a6788698-0516-4d8a-8fe8-2add6e7f6e94', 'f38c3884-111a-49d9-bcf1-6a965ff5e110', '3fa24970-97a7-4f46-ac55-0b24323fa402', '0a1a9f7e-73de-4620-ae03-4b1d50d7f706', '3045b911-01c5-4fc3-8e89-ac2d9cea12a8', '89aa06b4-bbf1-40c2-bb48-500c3aecdf48', '68e4df44-e581-4fa1-922b-1b78021d5d7b', '6771cbc4-3e4b-419f-b87f-2db662f6e010', 'e507db86-47c3-4953-96bb-c5e552b4f602', '4ed942cd-0f45-4d77-a66d-1d6c875877dc', 'f45b435f-0f64-41fe-a6ec-36683da765f9', '53e7a39c-e9ce-45c4-84af-632f2aac70ae', '378bbdd4-3077-4657-8055-fdc0a7600948', '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', 'dd44c60a-dd0f-4ff2-85ae-8c012af89cf9', '1cf499fb-10a0-4af2-afec-5f610dc85da6', 'ca102ce7-433c-4029-aabf-33d944165ff1'}, 'added': set(), 'removed': set(), 'updated': {'e507db86-47c3-4953-96bb-c5e552b4f602'}, 're_added': set()} {{(pid=107812) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 04 01:08:36.340661 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': 'e507db86-47c3-4953-96bb-c5e552b4f602', 'device_id': 'f0ee559e-077c-4e58-ab73-0bb5ccdf6fe7', 'network_id': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'port_id': 'e507db86-47c3-4953-96bb-c5e552b4f602', 'mac_address': 'fa:16:3e:14:e3:97', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '2b17f894-c374-4207-90ad-14f794c86627', 'ip_address': '172.37.7.41'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 01:08:36.376730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: e507db86-47c3-4953-96bb-c5e552b4f602 {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:08:36.377181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port e507db86-47c3-4953-96bb-c5e552b4f602 updated. Details: {'device': 'e507db86-47c3-4953-96bb-c5e552b4f602', 'device_id': 'f0ee559e-077c-4e58-ab73-0bb5ccdf6fe7', 'network_id': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'port_id': 'e507db86-47c3-4953-96bb-c5e552b4f602', 'mac_address': 'fa:16:3e:14:e3:97', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '2b17f894-c374-4207-90ad-14f794c86627', 'ip_address': '172.37.7.41'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 04 01:08:36.378913 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-e507db86-47, col_values=(('tag', 2),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:08:36.379332 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-e507db86-47, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:08:36.379721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-e507db86-47, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:08:36.380165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 01:08:36.380905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-e507db86-47, col_values=(('other_config', {'net_uuid': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:08:36.390205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 01:08:36.406589 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade55df,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 22}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:08:36.407913 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:353 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 18 devices currently available. Time elapsed: 0.068 Sep 04 01:08:36.412166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Refreshing firewall for 1 devices {{(pid=107812) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 04 01:08:36.415485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Refresh firewall rules Sep 04 01:08:36.416679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information for ports dict_keys([]) {{(pid=107812) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 04 01:08:36.416962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information {{(pid=107812) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 04 01:08:36.422688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 2 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:08:36.521983 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d820c69-1bf3-4c45-9669-1a6cf321efca]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:08:36.522610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:353 - agent port security group processed in 0.182 Sep 04 01:08:36.523386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for e507db86-47c3-4953-96bb-c5e552b4f602 to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 01:08:36.898490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Configuration for devices up ['e507db86-47c3-4953-96bb-c5e552b4f602'] and devices down [] completed. Sep 04 01:08:36.899059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:353 - ports processed. Elapsed:0.570 Sep 04 01:08:36.901520 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:353 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.570 Sep 04 01:08:37.031603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-467681d9-5edd-43ff-b9f5-a9aa4a68e33e None None] Resource Port 9db3ca9e-27d3-4852-b8c6-3fc745d2d055 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=9db3ca9e-27d3-4852-b8c6-3fc745d2d055,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=9db3ca9e-27d3-4852-b8c6-3fc745d2d055,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:08:37.032401 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-467681d9-5edd-43ff-b9f5-a9aa4a68e33e None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (9db3ca9e-27d3-4852-b8c6-3fc745d2d055), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:37.093537 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-7e6709c7-e5a0-48fc-b2fa-a513504ae980 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:08:36Z,description='Default security group',id=1bb45a56-42b8-452e-b03e-b012f54274c3,is_default=True,name='default',project_id='2e0ecc6513e54f9597cef651eabc4879',revision_number=1,rules=[SecurityGroupRule(3f880900-2dd3-4b36-b710-ac6ef186c6fe),SecurityGroupRule(645fe458-fbd4-42b9-9fb3-6ec1d6f1c8a8),SecurityGroupRule(66a40f26-e1ad-4521-8412-944322f10ec7),SecurityGroupRule(7a58ce1a-6cf9-4a51-8958-166e23739987)],shared=False,stateful=True,updated_at=2022-09-04T01:08:36Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:08:37.095136 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-7e6709c7-e5a0-48fc-b2fa-a513504ae980 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (1bb45a56-42b8-452e-b03e-b012f54274c3), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:37.096826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-7e6709c7-e5a0-48fc-b2fa-a513504ae980 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:08:36Z,description=,direction='ingress',ethertype='IPv6',id=3f880900-2dd3-4b36-b710-ac6ef186c6fe,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2e0ecc6513e54f9597cef651eabc4879',protocol=,remote_address_group_id=,remote_group_id=1bb45a56-42b8-452e-b03e-b012f54274c3,remote_ip_prefix=,revision_number=0,security_group_id=1bb45a56-42b8-452e-b03e-b012f54274c3,updated_at=2022-09-04T01:08:36Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:08:37.098339 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-7e6709c7-e5a0-48fc-b2fa-a513504ae980 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (3f880900-2dd3-4b36-b710-ac6ef186c6fe), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:37.098866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-7e6709c7-e5a0-48fc-b2fa-a513504ae980 admin admin] Security group rule updated ['1bb45a56-42b8-452e-b03e-b012f54274c3'] Sep 04 01:08:37.100098 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-7e6709c7-e5a0-48fc-b2fa-a513504ae980 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:08:36Z,description=,direction='egress',ethertype='IPv6',id=645fe458-fbd4-42b9-9fb3-6ec1d6f1c8a8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2e0ecc6513e54f9597cef651eabc4879',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=1bb45a56-42b8-452e-b03e-b012f54274c3,updated_at=2022-09-04T01:08:36Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:08:37.102234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-7e6709c7-e5a0-48fc-b2fa-a513504ae980 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (645fe458-fbd4-42b9-9fb3-6ec1d6f1c8a8), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:37.103371 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-7e6709c7-e5a0-48fc-b2fa-a513504ae980 admin admin] Security group rule updated ['1bb45a56-42b8-452e-b03e-b012f54274c3'] Sep 04 01:08:37.104332 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-7e6709c7-e5a0-48fc-b2fa-a513504ae980 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:08:36Z,description=,direction='ingress',ethertype='IPv4',id=66a40f26-e1ad-4521-8412-944322f10ec7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2e0ecc6513e54f9597cef651eabc4879',protocol=,remote_address_group_id=,remote_group_id=1bb45a56-42b8-452e-b03e-b012f54274c3,remote_ip_prefix=,revision_number=0,security_group_id=1bb45a56-42b8-452e-b03e-b012f54274c3,updated_at=2022-09-04T01:08:36Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:08:37.104901 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-7e6709c7-e5a0-48fc-b2fa-a513504ae980 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (66a40f26-e1ad-4521-8412-944322f10ec7), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:37.105928 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-7e6709c7-e5a0-48fc-b2fa-a513504ae980 admin admin] Security group rule updated ['1bb45a56-42b8-452e-b03e-b012f54274c3'] Sep 04 01:08:37.107268 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-7e6709c7-e5a0-48fc-b2fa-a513504ae980 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:08:36Z,description=,direction='egress',ethertype='IPv4',id=7a58ce1a-6cf9-4a51-8958-166e23739987,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2e0ecc6513e54f9597cef651eabc4879',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=1bb45a56-42b8-452e-b03e-b012f54274c3,updated_at=2022-09-04T01:08:36Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:08:37.108022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-7e6709c7-e5a0-48fc-b2fa-a513504ae980 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (7a58ce1a-6cf9-4a51-8958-166e23739987), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:37.109185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-7e6709c7-e5a0-48fc-b2fa-a513504ae980 admin admin] Security group rule updated ['1bb45a56-42b8-452e-b03e-b012f54274c3'] Sep 04 01:08:38.023092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-7e6709c7-e5a0-48fc-b2fa-a513504ae980 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-04T01:08:37Z,description='',dns_domain=None,id=235816d2-dc0c-4d16-940b-c00d2dfa0d18,mtu=1500,name='tempest-TestShelveInstance-985308805-network',project_id='2e0ecc6513e54f9597cef651eabc4879',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(235816d2-dc0c-4d16-940b-c00d2dfa0d18),segments=[NetworkSegment(abbe0616-13d4-47f1-9a7c-8e1bb8a244fd)],shared=False,status='ACTIVE',updated_at=2022-09-04T01:08:37Z,vlan_transparent=) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:08:38.023826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-7e6709c7-e5a0-48fc-b2fa-a513504ae980 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533'] for Network (235816d2-dc0c-4d16-940b-c00d2dfa0d18), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:38.068044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-467681d9-5edd-43ff-b9f5-a9aa4a68e33e None None] Resource Port 9db3ca9e-27d3-4852-b8c6-3fc745d2d055 updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=9db3ca9e-27d3-4852-b8c6-3fc745d2d055,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=9db3ca9e-27d3-4852-b8c6-3fc745d2d055,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=9db3ca9e-27d3-4852-b8c6-3fc745d2d055,segment=NetworkSegment(7f3c23b7-4619-4de8-89fe-789a39101159),segment_id=7f3c23b7-4619-4de8-89fe-789a39101159)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:08:38.068556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-467681d9-5edd-43ff-b9f5-a9aa4a68e33e None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (9db3ca9e-27d3-4852-b8c6-3fc745d2d055), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:38.110099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager [None req-7e6709c7-e5a0-48fc-b2fa-a513504ae980 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 235816d2-dc0c-4d16-940b-c00d2dfa0d18 with segmentation id not found. Sep 04 01:08:38.110099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 04 01:08:38.110099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 04 01:08:38.110099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 04 01:08:38.110099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 04 01:08:38.110099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 04 01:08:38.110099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 04 01:08:38.110099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 04 01:08:38.110099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 04 01:08:38.110099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 04 01:08:38.110099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 04 01:08:38.110099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 04 01:08:38.110099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 04 01:08:38.111065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 04 01:08:38.111065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 04 01:08:38.111065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 04 01:08:38.111065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 235816d2-dc0c-4d16-940b-c00d2dfa0d18 with segmentation id not found. Sep 04 01:08:38.111065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager Sep 04 01:08:38.329915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:354 started Sep 04 01:08:38.332964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade55e1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=724000000,duration_sec=727,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:08:38.333746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:08:38.334301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:354 - starting polling. Elapsed:0.005 Sep 04 01:08:38.336939 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:38.340310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:354 - port information retrieved. Elapsed:0.011 Sep 04 01:08:38.340641 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:354 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 04 01:08:38.547069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["2b42f268-c29f-4d98-b759-7a7107dd05d6","insert","qr-9db3ca9e-27",["set",[]],["map",[["attached-mac","fa:16:3e:50:56:80"],["iface-id","9db3ca9e-27d3-4852-b8c6-3fc745d2d055"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:08:38.557516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-a97af7df-efdc-46d2-9abe-9ac77dcc97a6 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(de4d9273-2a9c-49f1-b0bc-b8e71172fb64)],cidr=172.20.0.0/28,created_at=2022-09-04T01:08:38Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=14d0e241-d5e5-432d-8a38-2add02637159,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-TestShelveInstance-985308805-subnet',network_id=235816d2-dc0c-4d16-940b-c00d2dfa0d18,project_id='2e0ecc6513e54f9597cef651eabc4879',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-04T01:08:38Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:08:38.558136 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-a97af7df-efdc-46d2-9abe-9ac77dcc97a6 admin admin] Publish callbacks [] for Subnet (14d0e241-d5e5-432d-8a38-2add02637159), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:38.571824 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["2b42f268-c29f-4d98-b759-7a7107dd05d6","old",null,["set",[]],null],["","new","qr-9db3ca9e-27",23,["map",[["attached-mac","fa:16:3e:50:56:80"],["iface-id","9db3ca9e-27d3-4852-b8c6-3fc745d2d055"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:08:39.361721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-1ca3e171-a403-4f32-b269-0543e9d4b745 None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:08:38Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-235816d2-dc0c-4d16-940b-c00d2dfa0d18',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=b4f93563-ff7a-44c4-96a1-87f6e4348648,mac_address=fa:16:3e:c7:37:e2,name='',network_id=235816d2-dc0c-4d16-940b-c00d2dfa0d18,numa_affinity_policy=,project_id='2e0ecc6513e54f9597cef651eabc4879',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(b4f93563-ff7a-44c4-96a1-87f6e4348648),security_group_ids=set([]),status='DOWN',updated_at=2022-09-04T01:08:39Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:08:39.362408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-1ca3e171-a403-4f32-b269-0543e9d4b745 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (b4f93563-ff7a-44c4-96a1-87f6e4348648), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:39.635366 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-1ca3e171-a403-4f32-b269-0543e9d4b745 None None] Resource Port b4f93563-ff7a-44c4-96a1-87f6e4348648 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=b4f93563-ff7a-44c4-96a1-87f6e4348648,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=b4f93563-ff7a-44c4-96a1-87f6e4348648,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=b4f93563-ff7a-44c4-96a1-87f6e4348648,segment=NetworkSegment(abbe0616-13d4-47f1-9a7c-8e1bb8a244fd),segment_id=abbe0616-13d4-47f1-9a7c-8e1bb8a244fd)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:08:39.639736 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-1ca3e171-a403-4f32-b269-0543e9d4b745 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (b4f93563-ff7a-44c4-96a1-87f6e4348648), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:39.777450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["5bd68b58-c430-495c-8d1b-e967647c1ea4","insert","tapb4f93563-ff",["set",[]],["map",[["attached-mac","fa:16:3e:c7:37:e2"],["iface-id","b4f93563-ff7a-44c4-96a1-87f6e4348648"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:08:39.786929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["5bd68b58-c430-495c-8d1b-e967647c1ea4","old",null,["set",[]],null],["","new","tapb4f93563-ff",24,["map",[["attached-mac","fa:16:3e:c7:37:e2"],["iface-id","b4f93563-ff7a-44c4-96a1-87f6e4348648"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:08:40.136152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-214afc70-5597-48b8-808c-c45f746dcfdd admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:08:39Z,data_plane_status=None,description='',device_id='c7c609e2-c44b-4962-9209-ce53822f43c1',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=da545e71-9e15-495e-b08a-2c36ede84742,mac_address=fa:16:3e:ac:31:a7,name='',network_id=e8e0564a-d5c9-4fe0-b2d4-538f45096708,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(da545e71-9e15-495e-b08a-2c36ede84742),security_group_ids=set([]),status='DOWN',updated_at=2022-09-04T01:08:39Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:08:40.136609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-214afc70-5597-48b8-808c-c45f746dcfdd admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (da545e71-9e15-495e-b08a-2c36ede84742), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:40.330601 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:355 started Sep 04 01:08:40.333023 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade55e3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=725000000,duration_sec=729,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:08:40.333630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:08:40.334166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:355 - starting polling. Elapsed:0.004 Sep 04 01:08:40.336867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:40.340389 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:355 - port information retrieved. Elapsed:0.010 Sep 04 01:08:40.340726 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Starting to process devices in:{'current': {'c2f724af-5dbd-4d91-83cd-c5152b744599', 'a6788698-0516-4d8a-8fe8-2add6e7f6e94', 'f38c3884-111a-49d9-bcf1-6a965ff5e110', '9db3ca9e-27d3-4852-b8c6-3fc745d2d055', '3fa24970-97a7-4f46-ac55-0b24323fa402', '0a1a9f7e-73de-4620-ae03-4b1d50d7f706', '3045b911-01c5-4fc3-8e89-ac2d9cea12a8', '89aa06b4-bbf1-40c2-bb48-500c3aecdf48', '68e4df44-e581-4fa1-922b-1b78021d5d7b', '6771cbc4-3e4b-419f-b87f-2db662f6e010', 'e507db86-47c3-4953-96bb-c5e552b4f602', '4ed942cd-0f45-4d77-a66d-1d6c875877dc', 'f45b435f-0f64-41fe-a6ec-36683da765f9', '53e7a39c-e9ce-45c4-84af-632f2aac70ae', '378bbdd4-3077-4657-8055-fdc0a7600948', '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', 'dd44c60a-dd0f-4ff2-85ae-8c012af89cf9', 'b4f93563-ff7a-44c4-96a1-87f6e4348648', '1cf499fb-10a0-4af2-afec-5f610dc85da6', 'ca102ce7-433c-4029-aabf-33d944165ff1'}, 'added': {'b4f93563-ff7a-44c4-96a1-87f6e4348648', '9db3ca9e-27d3-4852-b8c6-3fc745d2d055'}, 'removed': set(), 'updated': {'b4f93563-ff7a-44c4-96a1-87f6e4348648'}, 're_added': set()} {{(pid=107812) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 04 01:08:40.341319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': 'b4f93563-ff7a-44c4-96a1-87f6e4348648', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-235816d2-dc0c-4d16-940b-c00d2dfa0d18', 'network_id': '235816d2-dc0c-4d16-940b-c00d2dfa0d18', 'port_id': 'b4f93563-ff7a-44c4-96a1-87f6e4348648', 'mac_address': 'fa:16:3e:c7:37:e2', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 155, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '14d0e241-d5e5-432d-8a38-2add02637159', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 01:08:40.341758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': '9db3ca9e-27d3-4852-b8c6-3fc745d2d055', 'device_id': 'f0ee559e-077c-4e58-ab73-0bb5ccdf6fe7', 'network_id': 'a4020194-c9cd-46d3-9c56-5d8c215c248f', 'port_id': '9db3ca9e-27d3-4852-b8c6-3fc745d2d055', 'mac_address': 'fa:16:3e:50:56:80', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 176, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '7ab2e9dc-328d-4fbf-b70b-2170fdc1a3db', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 01:08:40.345606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: b4f93563-ff7a-44c4-96a1-87f6e4348648 {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:08:40.345945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port b4f93563-ff7a-44c4-96a1-87f6e4348648 updated. Details: {'device': 'b4f93563-ff7a-44c4-96a1-87f6e4348648', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-235816d2-dc0c-4d16-940b-c00d2dfa0d18', 'network_id': '235816d2-dc0c-4d16-940b-c00d2dfa0d18', 'port_id': 'b4f93563-ff7a-44c4-96a1-87f6e4348648', 'mac_address': 'fa:16:3e:c7:37:e2', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 155, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '14d0e241-d5e5-432d-8a38-2add02637159', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Sep 04 01:08:40.346976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Assigning 10 as local vlan for net-id=235816d2-dc0c-4d16-940b-c00d2dfa0d18, seg-id=155 Sep 04 01:08:40.350062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0x1fd38c01,OFPFlowMod(buffer_id=4294967295,command=0,cookie=6561907047025962751,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4251), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4106}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:08:40.353807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0xeade55e5,OFPFlowMod(buffer_id=4294967295,command=0,cookie=6887031442322345889,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4106)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4251}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:08:40.354475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapb4f93563-ff, col_values=(('tag', 10),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:08:40.354905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tapb4f93563-ff, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:08:40.355323 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tapb4f93563-ff, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:08:40.359867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapb4f93563-ff, col_values=(('other_config', {'net_uuid': '235816d2-dc0c-4d16-940b-c00d2dfa0d18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '10', 'segmentation_id': '155'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:08:40.370104 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade55e7,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 24}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:08:40.370706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: 9db3ca9e-27d3-4852-b8c6-3fc745d2d055 {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:08:40.370968 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 9db3ca9e-27d3-4852-b8c6-3fc745d2d055 updated. Details: {'device': '9db3ca9e-27d3-4852-b8c6-3fc745d2d055', 'device_id': 'f0ee559e-077c-4e58-ab73-0bb5ccdf6fe7', 'network_id': 'a4020194-c9cd-46d3-9c56-5d8c215c248f', 'port_id': '9db3ca9e-27d3-4852-b8c6-3fc745d2d055', 'mac_address': 'fa:16:3e:50:56:80', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 176, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '7ab2e9dc-328d-4fbf-b70b-2170fdc1a3db', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 9} Sep 04 01:08:40.372087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-9db3ca9e-27, col_values=(('tag', 9),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:08:40.372752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-9db3ca9e-27, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:08:40.373561 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-9db3ca9e-27, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:08:40.384645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-9db3ca9e-27, col_values=(('other_config', {'net_uuid': 'a4020194-c9cd-46d3-9c56-5d8c215c248f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '9', 'segmentation_id': '176'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:08:40.397801 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade55e9,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 23}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:08:40.398154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:355 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 20 devices currently available. Time elapsed: 0.057 Sep 04 01:08:40.398519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Preparing device filters for 2 new devices {{(pid=107812) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 04 01:08:40.398813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Preparing filters for devices {'b4f93563-ff7a-44c4-96a1-87f6e4348648', '9db3ca9e-27d3-4852-b8c6-3fc745d2d055'} Sep 04 01:08:40.400517 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information for ports dict_keys([]) {{(pid=107812) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 04 01:08:40.400804 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information {{(pid=107812) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 04 01:08:40.406028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 4 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:08:40.480836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[2874aa68-4943-47fc-b119-8f13582d0810]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:08:40.481597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:355 - agent port security group processed in 0.140 Sep 04 01:08:40.482379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for b4f93563-ff7a-44c4-96a1-87f6e4348648 to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 01:08:40.482673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for 9db3ca9e-27d3-4852-b8c6-3fc745d2d055 to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 01:08:41.028849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Resource Port b4f93563-ff7a-44c4-96a1-87f6e4348648 updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:08:41.029370 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (b4f93563-ff7a-44c4-96a1-87f6e4348648), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:41.271747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Configuration for devices up ['b4f93563-ff7a-44c4-96a1-87f6e4348648', '9db3ca9e-27d3-4852-b8c6-3fc745d2d055'] and devices down [] completed. Sep 04 01:08:41.272260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:355 - ports processed. Elapsed:0.942 Sep 04 01:08:41.272774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:355 completed. Processed ports statistics: {'regular': {'added': 2, 'updated': 1, 'removed': 0}}. Elapsed:0.942 Sep 04 01:08:41.397263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Resource Port 9db3ca9e-27d3-4852-b8c6-3fc745d2d055 updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:08:41.398521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (9db3ca9e-27d3-4852-b8c6-3fc745d2d055), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:42.225140 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0990fdfc-9d04-42a8-bcb7-327948e674e7 None None] Resource Port da545e71-9e15-495e-b08a-2c36ede84742 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=da545e71-9e15-495e-b08a-2c36ede84742,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=da545e71-9e15-495e-b08a-2c36ede84742,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:08:42.225527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-0990fdfc-9d04-42a8-bcb7-327948e674e7 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (da545e71-9e15-495e-b08a-2c36ede84742), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:42.331251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:356 started Sep 04 01:08:42.333878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade55eb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=725000000,duration_sec=731,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:08:42.334473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:08:42.334806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:356 - starting polling. Elapsed:0.004 Sep 04 01:08:42.337927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:42.341813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:356 - port information retrieved. Elapsed:0.011 Sep 04 01:08:42.342155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Starting to process devices in:{'current': {'c2f724af-5dbd-4d91-83cd-c5152b744599', 'a6788698-0516-4d8a-8fe8-2add6e7f6e94', 'f38c3884-111a-49d9-bcf1-6a965ff5e110', '9db3ca9e-27d3-4852-b8c6-3fc745d2d055', '3fa24970-97a7-4f46-ac55-0b24323fa402', '0a1a9f7e-73de-4620-ae03-4b1d50d7f706', '3045b911-01c5-4fc3-8e89-ac2d9cea12a8', '89aa06b4-bbf1-40c2-bb48-500c3aecdf48', '68e4df44-e581-4fa1-922b-1b78021d5d7b', '6771cbc4-3e4b-419f-b87f-2db662f6e010', 'e507db86-47c3-4953-96bb-c5e552b4f602', '4ed942cd-0f45-4d77-a66d-1d6c875877dc', 'f45b435f-0f64-41fe-a6ec-36683da765f9', '53e7a39c-e9ce-45c4-84af-632f2aac70ae', '378bbdd4-3077-4657-8055-fdc0a7600948', '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', 'dd44c60a-dd0f-4ff2-85ae-8c012af89cf9', 'b4f93563-ff7a-44c4-96a1-87f6e4348648', '1cf499fb-10a0-4af2-afec-5f610dc85da6', 'ca102ce7-433c-4029-aabf-33d944165ff1'}, 'added': set(), 'removed': set(), 'updated': {'b4f93563-ff7a-44c4-96a1-87f6e4348648', '9db3ca9e-27d3-4852-b8c6-3fc745d2d055'}, 're_added': set()} {{(pid=107812) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 04 01:08:42.342784 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': 'b4f93563-ff7a-44c4-96a1-87f6e4348648', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-235816d2-dc0c-4d16-940b-c00d2dfa0d18', 'network_id': '235816d2-dc0c-4d16-940b-c00d2dfa0d18', 'port_id': 'b4f93563-ff7a-44c4-96a1-87f6e4348648', 'mac_address': 'fa:16:3e:c7:37:e2', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 155, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '14d0e241-d5e5-432d-8a38-2add02637159', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 01:08:42.343279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': '9db3ca9e-27d3-4852-b8c6-3fc745d2d055', 'device_id': 'f0ee559e-077c-4e58-ab73-0bb5ccdf6fe7', 'network_id': 'a4020194-c9cd-46d3-9c56-5d8c215c248f', 'port_id': '9db3ca9e-27d3-4852-b8c6-3fc745d2d055', 'mac_address': 'fa:16:3e:50:56:80', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 176, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '7ab2e9dc-328d-4fbf-b70b-2170fdc1a3db', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 01:08:42.346761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: b4f93563-ff7a-44c4-96a1-87f6e4348648 {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:08:42.347081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port b4f93563-ff7a-44c4-96a1-87f6e4348648 updated. Details: {'device': 'b4f93563-ff7a-44c4-96a1-87f6e4348648', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-235816d2-dc0c-4d16-940b-c00d2dfa0d18', 'network_id': '235816d2-dc0c-4d16-940b-c00d2dfa0d18', 'port_id': 'b4f93563-ff7a-44c4-96a1-87f6e4348648', 'mac_address': 'fa:16:3e:c7:37:e2', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 155, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '14d0e241-d5e5-432d-8a38-2add02637159', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 10} Sep 04 01:08:42.348359 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapb4f93563-ff, col_values=(('tag', 10),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:08:42.348893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tapb4f93563-ff, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:08:42.349309 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tapb4f93563-ff, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:08:42.349749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 01:08:42.350522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapb4f93563-ff, col_values=(('other_config', {'net_uuid': '235816d2-dc0c-4d16-940b-c00d2dfa0d18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '155', 'tag': '10'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:08:42.351179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 01:08:42.353436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade55ed,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 24}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:08:42.357043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: 9db3ca9e-27d3-4852-b8c6-3fc745d2d055 {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:08:42.357043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 9db3ca9e-27d3-4852-b8c6-3fc745d2d055 updated. Details: {'device': '9db3ca9e-27d3-4852-b8c6-3fc745d2d055', 'device_id': 'f0ee559e-077c-4e58-ab73-0bb5ccdf6fe7', 'network_id': 'a4020194-c9cd-46d3-9c56-5d8c215c248f', 'port_id': '9db3ca9e-27d3-4852-b8c6-3fc745d2d055', 'mac_address': 'fa:16:3e:50:56:80', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 176, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '7ab2e9dc-328d-4fbf-b70b-2170fdc1a3db', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 9} Sep 04 01:08:42.357043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-9db3ca9e-27, col_values=(('tag', 9),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:08:42.357348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-9db3ca9e-27, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:08:42.357348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-9db3ca9e-27, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:08:42.357348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 01:08:42.357538 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-9db3ca9e-27, col_values=(('other_config', {'net_uuid': 'a4020194-c9cd-46d3-9c56-5d8c215c248f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '176', 'tag': '9'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:08:42.358625 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 01:08:42.361349 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade55ef,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 23}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:08:42.362178 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:356 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 20 devices currently available. Time elapsed: 0.019 Sep 04 01:08:42.363224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Refreshing firewall for 2 devices {{(pid=107812) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 04 01:08:42.363224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Refresh firewall rules Sep 04 01:08:42.364574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information for ports dict_keys([]) {{(pid=107812) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 04 01:08:42.364859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information {{(pid=107812) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 04 01:08:42.370086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 4 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:08:42.435468 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[659bd3b2-7c7b-49bf-8e9b-aae7502643a7]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:08:42.436124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:356 - agent port security group processed in 0.094 Sep 04 01:08:42.437037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for b4f93563-ff7a-44c4-96a1-87f6e4348648 to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 01:08:42.437668 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for 9db3ca9e-27d3-4852-b8c6-3fc745d2d055 to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 01:08:42.530537 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0990fdfc-9d04-42a8-bcb7-327948e674e7 None None] Resource Port da545e71-9e15-495e-b08a-2c36ede84742 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=da545e71-9e15-495e-b08a-2c36ede84742,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=da545e71-9e15-495e-b08a-2c36ede84742,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=da545e71-9e15-495e-b08a-2c36ede84742,segment=NetworkSegment(c26850af-ca47-4ea8-9a33-a34f3381800e),segment_id=c26850af-ca47-4ea8-9a33-a34f3381800e)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:08:42.530926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-0990fdfc-9d04-42a8-bcb7-327948e674e7 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (da545e71-9e15-495e-b08a-2c36ede84742), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:42.862626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-003c00fa-54c1-44ae-9105-5d160ec3ca00 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:08:42Z,data_plane_status=None,description='',device_id='c7c609e2-c44b-4962-9209-ce53822f43c1',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=f0af75e4-63aa-44d3-bff7-973c3caf9bf9,mac_address=fa:16:3e:d7:5f:dc,name='',network_id=235816d2-dc0c-4d16-940b-c00d2dfa0d18,numa_affinity_policy=,project_id='2e0ecc6513e54f9597cef651eabc4879',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(f0af75e4-63aa-44d3-bff7-973c3caf9bf9),security_group_ids=set([]),status='DOWN',updated_at=2022-09-04T01:08:42Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:08:42.863380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-003c00fa-54c1-44ae-9105-5d160ec3ca00 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (f0af75e4-63aa-44d3-bff7-973c3caf9bf9), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:43.022662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Configuration for devices up ['b4f93563-ff7a-44c4-96a1-87f6e4348648', '9db3ca9e-27d3-4852-b8c6-3fc745d2d055'] and devices down [] completed. Sep 04 01:08:43.022981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:356 - ports processed. Elapsed:0.692 Sep 04 01:08:43.023321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:356 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 2, 'removed': 0}}. Elapsed:0.692 Sep 04 01:08:43.188612 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["f05d6238-ab29-48ce-877e-81d21268f45a","insert","qg-da545e71-9e",["set",[]],["map",[["attached-mac","fa:16:3e:ac:31:a7"],["iface-id","da545e71-9e15-495e-b08a-2c36ede84742"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:08:43.208451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["f05d6238-ab29-48ce-877e-81d21268f45a","old",null,["set",[]],null],["","new","qg-da545e71-9e",25,["map",[["attached-mac","fa:16:3e:ac:31:a7"],["iface-id","da545e71-9e15-495e-b08a-2c36ede84742"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:08:43.709235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-47e6fbe4-c704-4826-9e02-3301b2d81421 tempest-VolumesSnapshotTestJSON-1378097567 tempest-VolumesSnapshotTestJSON-1378097567-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:08:42Z,data_plane_status=None,description='',device_id='a3994b76-60e7-4d9a-a655-2fb09eb68a5d',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=88ae446d-0ce0-4187-b028-5915cabba54c,mac_address=fa:16:3e:06:ee:fa,name='',network_id=f5f50aa9-3a0d-4b0d-aee8-3b2aef89717d,numa_affinity_policy=,project_id='6071c3a795ba4aa098e3af8cde306d58',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(88ae446d-0ce0-4187-b028-5915cabba54c),security_group_ids=set([dd251723-c6f9-4e67-b522-e38b91c2bfeb]),status='DOWN',updated_at=2022-09-04T01:08:43Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:08:43.709872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-47e6fbe4-c704-4826-9e02-3301b2d81421 tempest-VolumesSnapshotTestJSON-1378097567 tempest-VolumesSnapshotTestJSON-1378097567-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (88ae446d-0ce0-4187-b028-5915cabba54c), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:43.710626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-47e6fbe4-c704-4826-9e02-3301b2d81421 tempest-VolumesSnapshotTestJSON-1378097567 tempest-VolumesSnapshotTestJSON-1378097567-project] Security group member updated {'dd251723-c6f9-4e67-b522-e38b91c2bfeb'} Sep 04 01:08:43.911737 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-003c00fa-54c1-44ae-9105-5d160ec3ca00 admin admin] Received resource Port update without any changes: f0af75e4-63aa-44d3-bff7-973c3caf9bf9 {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:181}} Sep 04 01:08:44.331964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:357 started Sep 04 01:08:44.334658 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade55f1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=726000000,duration_sec=733,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:08:44.335236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:08:44.335694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:357 - starting polling. Elapsed:0.004 Sep 04 01:08:44.338433 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:44.342450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:357 - port information retrieved. Elapsed:0.011 Sep 04 01:08:44.342782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Starting to process devices in:{'current': {'c2f724af-5dbd-4d91-83cd-c5152b744599', 'da545e71-9e15-495e-b08a-2c36ede84742', 'a6788698-0516-4d8a-8fe8-2add6e7f6e94', 'f38c3884-111a-49d9-bcf1-6a965ff5e110', '9db3ca9e-27d3-4852-b8c6-3fc745d2d055', '3fa24970-97a7-4f46-ac55-0b24323fa402', '0a1a9f7e-73de-4620-ae03-4b1d50d7f706', '3045b911-01c5-4fc3-8e89-ac2d9cea12a8', '89aa06b4-bbf1-40c2-bb48-500c3aecdf48', '68e4df44-e581-4fa1-922b-1b78021d5d7b', '6771cbc4-3e4b-419f-b87f-2db662f6e010', 'e507db86-47c3-4953-96bb-c5e552b4f602', '4ed942cd-0f45-4d77-a66d-1d6c875877dc', 'f45b435f-0f64-41fe-a6ec-36683da765f9', '53e7a39c-e9ce-45c4-84af-632f2aac70ae', '378bbdd4-3077-4657-8055-fdc0a7600948', '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', 'dd44c60a-dd0f-4ff2-85ae-8c012af89cf9', 'b4f93563-ff7a-44c4-96a1-87f6e4348648', '1cf499fb-10a0-4af2-afec-5f610dc85da6', 'ca102ce7-433c-4029-aabf-33d944165ff1'}, 'added': {'da545e71-9e15-495e-b08a-2c36ede84742'}, 'removed': set(), 'updated': {'da545e71-9e15-495e-b08a-2c36ede84742'}, 're_added': set()} {{(pid=107812) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 04 01:08:44.343658 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': 'da545e71-9e15-495e-b08a-2c36ede84742', 'device_id': 'c7c609e2-c44b-4962-9209-ce53822f43c1', 'network_id': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'port_id': 'da545e71-9e15-495e-b08a-2c36ede84742', 'mac_address': 'fa:16:3e:ac:31:a7', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '2b17f894-c374-4207-90ad-14f794c86627', 'ip_address': '172.37.7.36'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 01:08:44.347982 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: da545e71-9e15-495e-b08a-2c36ede84742 {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:08:44.348304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port da545e71-9e15-495e-b08a-2c36ede84742 updated. Details: {'device': 'da545e71-9e15-495e-b08a-2c36ede84742', 'device_id': 'c7c609e2-c44b-4962-9209-ce53822f43c1', 'network_id': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'port_id': 'da545e71-9e15-495e-b08a-2c36ede84742', 'mac_address': 'fa:16:3e:ac:31:a7', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '2b17f894-c374-4207-90ad-14f794c86627', 'ip_address': '172.37.7.36'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 04 01:08:44.349441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-da545e71-9e, col_values=(('tag', 2),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:08:44.349867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-da545e71-9e, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:08:44.350277 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-da545e71-9e, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:08:44.357189 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-da545e71-9e, col_values=(('other_config', {'net_uuid': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:08:44.364226 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade55f3,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 25}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:08:44.364727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:357 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 21 devices currently available. Time elapsed: 0.021 Sep 04 01:08:44.365095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Preparing device filters for 1 new devices {{(pid=107812) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 04 01:08:44.365586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Preparing filters for devices {'da545e71-9e15-495e-b08a-2c36ede84742'} Sep 04 01:08:44.366870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information for ports dict_keys([]) {{(pid=107812) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 04 01:08:44.367309 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information {{(pid=107812) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 04 01:08:44.371793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 2 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:08:44.428741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30adf99-953b-41b8-8093-7710a6a498a8]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:08:44.428741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:357 - agent port security group processed in 0.082 Sep 04 01:08:44.428741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for da545e71-9e15-495e-b08a-2c36ede84742 to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 01:08:44.656753 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Configuration for devices up ['da545e71-9e15-495e-b08a-2c36ede84742'] and devices down [] completed. Sep 04 01:08:44.657068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:357 - ports processed. Elapsed:0.325 Sep 04 01:08:44.657453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:357 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.326 Sep 04 01:08:44.714114 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Resource Port da545e71-9e15-495e-b08a-2c36ede84742 updated (revision_number 3->4). Old fields: {'status': 'DOWN', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=da545e71-9e15-495e-b08a-2c36ede84742,segment=NetworkSegment(c26850af-ca47-4ea8-9a33-a34f3381800e),segment_id=c26850af-ca47-4ea8-9a33-a34f3381800e)]} New fields: {'status': 'ACTIVE', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=da545e71-9e15-495e-b08a-2c36ede84742,segment=NetworkSegment(c26850af-ca47-4ea8-9a33-a34f3381800e),segment_id=c26850af-ca47-4ea8-9a33-a34f3381800e)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:08:44.715302 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (da545e71-9e15-495e-b08a-2c36ede84742), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:45.051279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-f8bbfccd-30e8-46af-af88-58c622e43015 tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:08:44Z,description='tempest-secgroup-smoke-2111062138 description',id=270d62da-5350-44de-9262-a4399d8651e3,is_default=False,name='tempest-secgroup-smoke-2111062138',project_id='735896cd6b3b4c448dd94b3bf7577cb8',revision_number=1,rules=[SecurityGroupRule(9c61bb4b-810a-4263-92c9-1368ff827f90),SecurityGroupRule(bd663084-377e-4589-9d3f-e256469835d1)],shared=False,stateful=True,updated_at=2022-09-04T01:08:44Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:08:45.051807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-f8bbfccd-30e8-46af-af88-58c622e43015 tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (270d62da-5350-44de-9262-a4399d8651e3), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:45.052482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-f8bbfccd-30e8-46af-af88-58c622e43015 tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:08:44Z,description=,direction='egress',ethertype='IPv4',id=9c61bb4b-810a-4263-92c9-1368ff827f90,normalized_cidr=None,port_range_max=,port_range_min=,project_id='735896cd6b3b4c448dd94b3bf7577cb8',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=270d62da-5350-44de-9262-a4399d8651e3,updated_at=2022-09-04T01:08:44Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:08:45.052906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-f8bbfccd-30e8-46af-af88-58c622e43015 tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (9c61bb4b-810a-4263-92c9-1368ff827f90), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:45.053327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-f8bbfccd-30e8-46af-af88-58c622e43015 tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] Security group rule updated ['270d62da-5350-44de-9262-a4399d8651e3'] Sep 04 01:08:45.054122 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-f8bbfccd-30e8-46af-af88-58c622e43015 tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:08:44Z,description=,direction='egress',ethertype='IPv6',id=bd663084-377e-4589-9d3f-e256469835d1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='735896cd6b3b4c448dd94b3bf7577cb8',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=270d62da-5350-44de-9262-a4399d8651e3,updated_at=2022-09-04T01:08:44Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:08:45.054529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-f8bbfccd-30e8-46af-af88-58c622e43015 tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (bd663084-377e-4589-9d3f-e256469835d1), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:45.055133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-f8bbfccd-30e8-46af-af88-58c622e43015 tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] Security group rule updated ['270d62da-5350-44de-9262-a4399d8651e3'] Sep 04 01:08:45.347975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-2cee59bf-146c-40a6-ade5-a228a5758748 tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:08:45Z,description='',direction='ingress',ethertype='IPv4',id=4f7cf12d-b606-4451-9c0b-17cb4e4655db,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='735896cd6b3b4c448dd94b3bf7577cb8',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=270d62da-5350-44de-9262-a4399d8651e3,updated_at=2022-09-04T01:08:45Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:08:45.348439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-2cee59bf-146c-40a6-ade5-a228a5758748 tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (4f7cf12d-b606-4451-9c0b-17cb4e4655db), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:45.349050 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-2cee59bf-146c-40a6-ade5-a228a5758748 tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] Security group rule updated ['270d62da-5350-44de-9262-a4399d8651e3'] Sep 04 01:08:45.695050 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-8d5f3426-6b6c-4fc2-a0ae-548e87fc7700 tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:08:45Z,description='',direction='egress',ethertype='IPv4',id=71660eff-3edf-4824-9433-e2af0849d0ac,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='735896cd6b3b4c448dd94b3bf7577cb8',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=270d62da-5350-44de-9262-a4399d8651e3,updated_at=2022-09-04T01:08:45Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:08:45.695516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-8d5f3426-6b6c-4fc2-a0ae-548e87fc7700 tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (71660eff-3edf-4824-9433-e2af0849d0ac), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:45.695941 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-8d5f3426-6b6c-4fc2-a0ae-548e87fc7700 tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] Security group rule updated ['270d62da-5350-44de-9262-a4399d8651e3'] Sep 04 01:08:45.893804 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-46a2da47-726b-46fc-ac29-734035cd72a7 service neutron] Resource Port 88ae446d-0ce0-4187-b028-5915cabba54c updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=88ae446d-0ce0-4187-b028-5915cabba54c,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=88ae446d-0ce0-4187-b028-5915cabba54c,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:08:45.894515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-46a2da47-726b-46fc-ac29-734035cd72a7 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (88ae446d-0ce0-4187-b028-5915cabba54c), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:46.073167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-7a4a1032-a842-45c9-9879-9c6aafec9d05 tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:08:45Z,description='',direction='ingress',ethertype='IPv4',id=afe23fac-44f4-4fbc-8c58-9dc12cc0222b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='735896cd6b3b4c448dd94b3bf7577cb8',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=270d62da-5350-44de-9262-a4399d8651e3,updated_at=2022-09-04T01:08:45Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:08:46.073550 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-7a4a1032-a842-45c9-9879-9c6aafec9d05 tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (afe23fac-44f4-4fbc-8c58-9dc12cc0222b), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:46.073898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-7a4a1032-a842-45c9-9879-9c6aafec9d05 tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] Security group rule updated ['270d62da-5350-44de-9262-a4399d8651e3'] Sep 04 01:08:46.172935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-46a2da47-726b-46fc-ac29-734035cd72a7 service neutron] Resource Port 88ae446d-0ce0-4187-b028-5915cabba54c updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=88ae446d-0ce0-4187-b028-5915cabba54c,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=88ae446d-0ce0-4187-b028-5915cabba54c,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=88ae446d-0ce0-4187-b028-5915cabba54c,segment=NetworkSegment(691a306c-3c07-49ca-8d5b-c7e7a9ad5919),segment_id=691a306c-3c07-49ca-8d5b-c7e7a9ad5919)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:08:46.173351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-46a2da47-726b-46fc-ac29-734035cd72a7 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (88ae446d-0ce0-4187-b028-5915cabba54c), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:46.255502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-6905b4f0-eea6-48ac-bcdd-a1620704d346 None None] Resource Port f0af75e4-63aa-44d3-bff7-973c3caf9bf9 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=f0af75e4-63aa-44d3-bff7-973c3caf9bf9,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=f0af75e4-63aa-44d3-bff7-973c3caf9bf9,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:08:46.261022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-6905b4f0-eea6-48ac-bcdd-a1620704d346 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (f0af75e4-63aa-44d3-bff7-973c3caf9bf9), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:46.332542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:358 started Sep 04 01:08:46.335395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade55f5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=727000000,duration_sec=735,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:08:46.336009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:08:46.336352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:358 - starting polling. Elapsed:0.004 Sep 04 01:08:46.339797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:46.343963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:358 - port information retrieved. Elapsed:0.012 Sep 04 01:08:46.344307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Starting to process devices in:{'current': {'c2f724af-5dbd-4d91-83cd-c5152b744599', 'da545e71-9e15-495e-b08a-2c36ede84742', 'a6788698-0516-4d8a-8fe8-2add6e7f6e94', 'f38c3884-111a-49d9-bcf1-6a965ff5e110', '9db3ca9e-27d3-4852-b8c6-3fc745d2d055', '3fa24970-97a7-4f46-ac55-0b24323fa402', '0a1a9f7e-73de-4620-ae03-4b1d50d7f706', '3045b911-01c5-4fc3-8e89-ac2d9cea12a8', '89aa06b4-bbf1-40c2-bb48-500c3aecdf48', '68e4df44-e581-4fa1-922b-1b78021d5d7b', '6771cbc4-3e4b-419f-b87f-2db662f6e010', 'e507db86-47c3-4953-96bb-c5e552b4f602', '4ed942cd-0f45-4d77-a66d-1d6c875877dc', 'f45b435f-0f64-41fe-a6ec-36683da765f9', '53e7a39c-e9ce-45c4-84af-632f2aac70ae', '378bbdd4-3077-4657-8055-fdc0a7600948', '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', 'dd44c60a-dd0f-4ff2-85ae-8c012af89cf9', 'b4f93563-ff7a-44c4-96a1-87f6e4348648', '1cf499fb-10a0-4af2-afec-5f610dc85da6', 'ca102ce7-433c-4029-aabf-33d944165ff1'}, 'added': set(), 'removed': set(), 'updated': {'da545e71-9e15-495e-b08a-2c36ede84742'}, 're_added': set()} {{(pid=107812) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 04 01:08:46.345200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': 'da545e71-9e15-495e-b08a-2c36ede84742', 'device_id': 'c7c609e2-c44b-4962-9209-ce53822f43c1', 'network_id': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'port_id': 'da545e71-9e15-495e-b08a-2c36ede84742', 'mac_address': 'fa:16:3e:ac:31:a7', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '2b17f894-c374-4207-90ad-14f794c86627', 'ip_address': '172.37.7.36'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 01:08:46.349974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: da545e71-9e15-495e-b08a-2c36ede84742 {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:08:46.350303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port da545e71-9e15-495e-b08a-2c36ede84742 updated. Details: {'device': 'da545e71-9e15-495e-b08a-2c36ede84742', 'device_id': 'c7c609e2-c44b-4962-9209-ce53822f43c1', 'network_id': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'port_id': 'da545e71-9e15-495e-b08a-2c36ede84742', 'mac_address': 'fa:16:3e:ac:31:a7', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '2b17f894-c374-4207-90ad-14f794c86627', 'ip_address': '172.37.7.36'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 04 01:08:46.351521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-da545e71-9e, col_values=(('tag', 2),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:08:46.352084 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-da545e71-9e, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:08:46.352492 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-da545e71-9e, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:08:46.352941 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 01:08:46.353885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-da545e71-9e, col_values=(('other_config', {'net_uuid': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:08:46.354529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 01:08:46.356980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade55f7,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 25}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:08:46.357523 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:358 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 21 devices currently available. Time elapsed: 0.013 Sep 04 01:08:46.358018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Refreshing firewall for 1 devices {{(pid=107812) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 04 01:08:46.358470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Refresh firewall rules Sep 04 01:08:46.360194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information for ports dict_keys([]) {{(pid=107812) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 04 01:08:46.360480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information {{(pid=107812) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 04 01:08:46.365627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 2 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:08:46.416475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[311796aa-79b5-4d37-8eb6-ae42be1ff415]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:08:46.417518 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:358 - agent port security group processed in 0.072 Sep 04 01:08:46.419188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for da545e71-9e15-495e-b08a-2c36ede84742 to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 01:08:46.427233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-1c50ea51-1b82-483f-a476-a31c6e5cae40 tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:08:46Z,description='',direction='egress',ethertype='IPv4',id=d306de2e-c68c-4493-8eb3-7981adee1a7a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='735896cd6b3b4c448dd94b3bf7577cb8',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=270d62da-5350-44de-9262-a4399d8651e3,updated_at=2022-09-04T01:08:46Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:08:46.427819 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-1c50ea51-1b82-483f-a476-a31c6e5cae40 tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (d306de2e-c68c-4493-8eb3-7981adee1a7a), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:46.428348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-1c50ea51-1b82-483f-a476-a31c6e5cae40 tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] Security group rule updated ['270d62da-5350-44de-9262-a4399d8651e3'] Sep 04 01:08:46.567131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Configuration for devices up ['da545e71-9e15-495e-b08a-2c36ede84742'] and devices down [] completed. Sep 04 01:08:46.567716 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:358 - ports processed. Elapsed:0.235 Sep 04 01:08:46.568297 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:358 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.236 Sep 04 01:08:46.609746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-6905b4f0-eea6-48ac-bcdd-a1620704d346 None None] Resource Port f0af75e4-63aa-44d3-bff7-973c3caf9bf9 updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=f0af75e4-63aa-44d3-bff7-973c3caf9bf9,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=f0af75e4-63aa-44d3-bff7-973c3caf9bf9,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=f0af75e4-63aa-44d3-bff7-973c3caf9bf9,segment=NetworkSegment(abbe0616-13d4-47f1-9a7c-8e1bb8a244fd),segment_id=abbe0616-13d4-47f1-9a7c-8e1bb8a244fd)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:08:46.610477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-6905b4f0-eea6-48ac-bcdd-a1620704d346 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (f0af75e4-63aa-44d3-bff7-973c3caf9bf9), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:46.769901 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-021633aa-c632-4415-835f-f2ace72c8533 tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:08:46Z,description='',direction='ingress',ethertype='IPv6',id=9c8fb840-8e21-4e3a-8f04-46abea003990,normalized_cidr=None,port_range_max=,port_range_min=,project_id='735896cd6b3b4c448dd94b3bf7577cb8',protocol='ipv6-icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=270d62da-5350-44de-9262-a4399d8651e3,updated_at=2022-09-04T01:08:46Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:08:46.770405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-021633aa-c632-4415-835f-f2ace72c8533 tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (9c8fb840-8e21-4e3a-8f04-46abea003990), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:46.770986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-021633aa-c632-4415-835f-f2ace72c8533 tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] Security group rule updated ['270d62da-5350-44de-9262-a4399d8651e3'] Sep 04 01:08:46.974766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["98b725d3-6ceb-470f-b2fb-dc9ff0f3878e","insert","qr-f0af75e4-63",["set",[]],["map",[["attached-mac","fa:16:3e:d7:5f:dc"],["iface-id","f0af75e4-63aa-44d3-bff7-973c3caf9bf9"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:08:47.005174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["98b725d3-6ceb-470f-b2fb-dc9ff0f3878e","old",null,["set",[]],null],["","new","qr-f0af75e4-63",26,["map",[["attached-mac","fa:16:3e:d7:5f:dc"],["iface-id","f0af75e4-63aa-44d3-bff7-973c3caf9bf9"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:08:47.259354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-6f325fa3-f715-4db1-a2d9-38b823788f78 tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:08:47Z,description='',direction='egress',ethertype='IPv6',id=47ebbefa-cdae-49cc-a540-4c2b9dab5d28,normalized_cidr=None,port_range_max=,port_range_min=,project_id='735896cd6b3b4c448dd94b3bf7577cb8',protocol='ipv6-icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=270d62da-5350-44de-9262-a4399d8651e3,updated_at=2022-09-04T01:08:47Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:08:47.260258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-6f325fa3-f715-4db1-a2d9-38b823788f78 tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (47ebbefa-cdae-49cc-a540-4c2b9dab5d28), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:47.260690 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-6f325fa3-f715-4db1-a2d9-38b823788f78 tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] Security group rule updated ['270d62da-5350-44de-9262-a4399d8651e3'] Sep 04 01:08:47.297499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-74538b60-0668-4b69-b76c-5b0878c80859 tempest-VolumesActionsTest-1122363192 tempest-VolumesActionsTest-1122363192-project] Resource Port deleted: 1f56da33-407e-4160-b5c8-764c4a91f864 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:08:47.298293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-74538b60-0668-4b69-b76c-5b0878c80859 tempest-VolumesActionsTest-1122363192 tempest-VolumesActionsTest-1122363192-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (1f56da33-407e-4160-b5c8-764c4a91f864), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:47.298408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-74538b60-0668-4b69-b76c-5b0878c80859 tempest-VolumesActionsTest-1122363192 tempest-VolumesActionsTest-1122363192-project] Security group member updated {'47886e6f-b931-4c89-84ae-31a8725f8d25'} Sep 04 01:08:48.333545 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:359 started Sep 04 01:08:48.336051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade55f9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=728000000,duration_sec=737,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:08:48.336621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:08:48.337094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:359 - starting polling. Elapsed:0.004 Sep 04 01:08:48.340087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:48.342074 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 1f56da33-407e-4160-b5c8-764c4a91f864 not present in bridge br-int Sep 04 01:08:48.342408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] net_uuid None not managed by VLAN manager Sep 04 01:08:48.342750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for ['1f56da33-407e-4160-b5c8-764c4a91f864'] Sep 04 01:08:48.343086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 1f56da33-407e-4160-b5c8-764c4a91f864 is not handled by the firewall. {{(pid=107812) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 04 01:08:48.347736 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:359 - port information retrieved. Elapsed:0.014 Sep 04 01:08:48.347977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Starting to process devices in:{'current': {'c2f724af-5dbd-4d91-83cd-c5152b744599', 'da545e71-9e15-495e-b08a-2c36ede84742', 'a6788698-0516-4d8a-8fe8-2add6e7f6e94', 'f38c3884-111a-49d9-bcf1-6a965ff5e110', '9db3ca9e-27d3-4852-b8c6-3fc745d2d055', '3fa24970-97a7-4f46-ac55-0b24323fa402', '0a1a9f7e-73de-4620-ae03-4b1d50d7f706', '3045b911-01c5-4fc3-8e89-ac2d9cea12a8', '89aa06b4-bbf1-40c2-bb48-500c3aecdf48', '68e4df44-e581-4fa1-922b-1b78021d5d7b', '6771cbc4-3e4b-419f-b87f-2db662f6e010', 'e507db86-47c3-4953-96bb-c5e552b4f602', '4ed942cd-0f45-4d77-a66d-1d6c875877dc', 'f45b435f-0f64-41fe-a6ec-36683da765f9', '53e7a39c-e9ce-45c4-84af-632f2aac70ae', '378bbdd4-3077-4657-8055-fdc0a7600948', '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', 'dd44c60a-dd0f-4ff2-85ae-8c012af89cf9', 'b4f93563-ff7a-44c4-96a1-87f6e4348648', 'f0af75e4-63aa-44d3-bff7-973c3caf9bf9', '1cf499fb-10a0-4af2-afec-5f610dc85da6', 'ca102ce7-433c-4029-aabf-33d944165ff1'}, 'added': {'f0af75e4-63aa-44d3-bff7-973c3caf9bf9'}, 'removed': set(), 'updated': {'f0af75e4-63aa-44d3-bff7-973c3caf9bf9'}, 're_added': set()} {{(pid=107812) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 04 01:08:48.348536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': 'f0af75e4-63aa-44d3-bff7-973c3caf9bf9', 'device_id': 'c7c609e2-c44b-4962-9209-ce53822f43c1', 'network_id': '235816d2-dc0c-4d16-940b-c00d2dfa0d18', 'port_id': 'f0af75e4-63aa-44d3-bff7-973c3caf9bf9', 'mac_address': 'fa:16:3e:d7:5f:dc', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 155, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '14d0e241-d5e5-432d-8a38-2add02637159', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 01:08:48.352266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: f0af75e4-63aa-44d3-bff7-973c3caf9bf9 {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:08:48.352582 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port f0af75e4-63aa-44d3-bff7-973c3caf9bf9 updated. Details: {'device': 'f0af75e4-63aa-44d3-bff7-973c3caf9bf9', 'device_id': 'c7c609e2-c44b-4962-9209-ce53822f43c1', 'network_id': '235816d2-dc0c-4d16-940b-c00d2dfa0d18', 'port_id': 'f0af75e4-63aa-44d3-bff7-973c3caf9bf9', 'mac_address': 'fa:16:3e:d7:5f:dc', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 155, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '14d0e241-d5e5-432d-8a38-2add02637159', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 10} Sep 04 01:08:48.353553 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-f0af75e4-63, col_values=(('tag', 10),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:08:48.354151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-f0af75e4-63, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:08:48.354423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-f0af75e4-63, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:08:48.364089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-f0af75e4-63, col_values=(('other_config', {'net_uuid': '235816d2-dc0c-4d16-940b-c00d2dfa0d18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '10', 'segmentation_id': '155'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:08:48.375617 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade55fb,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 26}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:08:48.376238 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:359 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 22 devices currently available. Time elapsed: 0.028 Sep 04 01:08:48.376811 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Preparing device filters for 1 new devices {{(pid=107812) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 04 01:08:48.377454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Preparing filters for devices {'f0af75e4-63aa-44d3-bff7-973c3caf9bf9'} Sep 04 01:08:48.378652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information for ports dict_keys([]) {{(pid=107812) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 04 01:08:48.378988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information {{(pid=107812) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 04 01:08:48.383949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 2 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:08:48.431952 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[383c05f9-87c1-4989-8d92-b0b6fe13a96e]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:08:48.432863 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:359 - agent port security group processed in 0.085 Sep 04 01:08:48.433752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for f0af75e4-63aa-44d3-bff7-973c3caf9bf9 to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 01:08:48.656593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Configuration for devices up ['f0af75e4-63aa-44d3-bff7-973c3caf9bf9'] and devices down [] completed. Sep 04 01:08:48.656980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:359 - ports processed. Elapsed:0.324 Sep 04 01:08:48.657402 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:359 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.324 Sep 04 01:08:48.714303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Resource Port f0af75e4-63aa-44d3-bff7-973c3caf9bf9 updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:08:48.717749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (f0af75e4-63aa-44d3-bff7-973c3caf9bf9), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:49.355617 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Resource Port fcbc60fd-1785-4f94-9436-a520ec06cdaf updated (revision_number 8->9). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:08:49.356234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (fcbc60fd-1785-4f94-9436-a520ec06cdaf), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:50.334949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:360 started Sep 04 01:08:50.337888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade55fd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=729000000,duration_sec=739,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:08:50.338502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:08:50.338838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:360 - starting polling. Elapsed:0.004 Sep 04 01:08:50.342107 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:50.347699 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:360 - port information retrieved. Elapsed:0.013 Sep 04 01:08:50.348049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Starting to process devices in:{'current': {'c2f724af-5dbd-4d91-83cd-c5152b744599', 'da545e71-9e15-495e-b08a-2c36ede84742', 'a6788698-0516-4d8a-8fe8-2add6e7f6e94', 'f38c3884-111a-49d9-bcf1-6a965ff5e110', '9db3ca9e-27d3-4852-b8c6-3fc745d2d055', '3fa24970-97a7-4f46-ac55-0b24323fa402', '0a1a9f7e-73de-4620-ae03-4b1d50d7f706', '3045b911-01c5-4fc3-8e89-ac2d9cea12a8', '89aa06b4-bbf1-40c2-bb48-500c3aecdf48', '68e4df44-e581-4fa1-922b-1b78021d5d7b', '6771cbc4-3e4b-419f-b87f-2db662f6e010', 'e507db86-47c3-4953-96bb-c5e552b4f602', '4ed942cd-0f45-4d77-a66d-1d6c875877dc', 'f45b435f-0f64-41fe-a6ec-36683da765f9', '53e7a39c-e9ce-45c4-84af-632f2aac70ae', '378bbdd4-3077-4657-8055-fdc0a7600948', '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', 'dd44c60a-dd0f-4ff2-85ae-8c012af89cf9', 'b4f93563-ff7a-44c4-96a1-87f6e4348648', 'f0af75e4-63aa-44d3-bff7-973c3caf9bf9', '1cf499fb-10a0-4af2-afec-5f610dc85da6', 'ca102ce7-433c-4029-aabf-33d944165ff1'}, 'added': set(), 'removed': set(), 'updated': {'f0af75e4-63aa-44d3-bff7-973c3caf9bf9'}, 're_added': set()} {{(pid=107812) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 04 01:08:50.349248 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': 'f0af75e4-63aa-44d3-bff7-973c3caf9bf9', 'device_id': 'c7c609e2-c44b-4962-9209-ce53822f43c1', 'network_id': '235816d2-dc0c-4d16-940b-c00d2dfa0d18', 'port_id': 'f0af75e4-63aa-44d3-bff7-973c3caf9bf9', 'mac_address': 'fa:16:3e:d7:5f:dc', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 155, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '14d0e241-d5e5-432d-8a38-2add02637159', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 01:08:50.354038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: f0af75e4-63aa-44d3-bff7-973c3caf9bf9 {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:08:50.354367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port f0af75e4-63aa-44d3-bff7-973c3caf9bf9 updated. Details: {'device': 'f0af75e4-63aa-44d3-bff7-973c3caf9bf9', 'device_id': 'c7c609e2-c44b-4962-9209-ce53822f43c1', 'network_id': '235816d2-dc0c-4d16-940b-c00d2dfa0d18', 'port_id': 'f0af75e4-63aa-44d3-bff7-973c3caf9bf9', 'mac_address': 'fa:16:3e:d7:5f:dc', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 155, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '14d0e241-d5e5-432d-8a38-2add02637159', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 10} Sep 04 01:08:50.359053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-f0af75e4-63, col_values=(('tag', 10),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:08:50.359053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-f0af75e4-63, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:08:50.359053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-f0af75e4-63, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:08:50.365761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 01:08:50.368031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-f0af75e4-63, col_values=(('other_config', {'net_uuid': '235816d2-dc0c-4d16-940b-c00d2dfa0d18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '155', 'tag': '10'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:08:50.369523 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 01:08:50.372903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade55ff,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 26}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:08:50.373294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:360 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 22 devices currently available. Time elapsed: 0.025 Sep 04 01:08:50.373979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Refreshing firewall for 1 devices {{(pid=107812) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 04 01:08:50.374336 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Refresh firewall rules Sep 04 01:08:50.375580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information for ports dict_keys([]) {{(pid=107812) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 04 01:08:50.375977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information {{(pid=107812) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 04 01:08:50.381032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 2 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:08:50.422210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69f3939-ecc7-492d-b753-8d5ed6d67a2d]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:08:50.423063 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:360 - agent port security group processed in 0.075 Sep 04 01:08:50.425641 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for f0af75e4-63aa-44d3-bff7-973c3caf9bf9 to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 01:08:50.590082 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Configuration for devices up ['f0af75e4-63aa-44d3-bff7-973c3caf9bf9'] and devices down [] completed. Sep 04 01:08:50.590400 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:360 - ports processed. Elapsed:0.256 Sep 04 01:08:50.590732 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:360 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.256 Sep 04 01:08:51.708948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Resource Port fcbc60fd-1785-4f94-9436-a520ec06cdaf updated (revision_number 9->10). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:08:51.708948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (fcbc60fd-1785-4f94-9436-a520ec06cdaf), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:51.754974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Resource Port 88ae446d-0ce0-4187-b028-5915cabba54c updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:08:51.755378 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (88ae446d-0ce0-4187-b028-5915cabba54c), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:52.335719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:361 started Sep 04 01:08:52.338180 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5601,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=730000000,duration_sec=741,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:08:52.338749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:08:52.339074 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:361 - starting polling. Elapsed:0.004 Sep 04 01:08:52.341948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:52.345840 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:361 - port information retrieved. Elapsed:0.010 Sep 04 01:08:52.346971 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:361 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 04 01:08:54.336270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:362 started Sep 04 01:08:54.338749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5603,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=730000000,duration_sec=743,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:08:54.339316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:08:54.339672 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:362 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:08:56.337378 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:363 started Sep 04 01:08:56.340490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5605,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=732000000,duration_sec=745,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:08:56.341828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:08:56.342289 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:363 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 04 01:08:56.673859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Resource Port 88ae446d-0ce0-4187-b028-5915cabba54c updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:08:56.674242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (88ae446d-0ce0-4187-b028-5915cabba54c), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:58.338052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:364 started Sep 04 01:08:58.340531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5607,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=732000000,duration_sec=747,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:08:58.341111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:08:58.341442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:364 - starting polling. Elapsed:0.004 Sep 04 01:08:58.344222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:08:58.348627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:364 - port information retrieved. Elapsed:0.011 Sep 04 01:08:58.352509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:364 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 04 01:09:00.338728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:365 started Sep 04 01:09:00.342007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5609,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=733000000,duration_sec=749,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:09:00.342772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:09:00.343256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:365 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 04 01:09:02.340043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:366 started Sep 04 01:09:02.342462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade560b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=734000000,duration_sec=751,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:09:02.343026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:09:02.343450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:366 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:09:04.341264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:367 started Sep 04 01:09:04.344791 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade560d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=736000000,duration_sec=753,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:09:04.345730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:09:04.349363 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:367 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 04 01:09:06.345940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:368 started Sep 04 01:09:06.351787 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade560f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=740000000,duration_sec=755,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:09:06.352464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:09:06.352854 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:368 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 04 01:09:08.347002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:369 started Sep 04 01:09:08.352594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5611,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=743000000,duration_sec=757,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:09:08.355154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:09:08.355154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:369 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 04 01:09:10.348526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:370 started Sep 04 01:09:10.351100 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5613,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=743000000,duration_sec=759,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:09:10.351750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:09:10.352709 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:370 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 04 01:09:12.350468 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:371 started Sep 04 01:09:12.356029 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5615,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=746000000,duration_sec=761,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:09:12.357204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:09:12.357828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:371 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 04 01:09:14.355712 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:372 started Sep 04 01:09:14.371292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5617,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=754000000,duration_sec=763,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:09:14.372108 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:09:14.372527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:372 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.017 Sep 04 01:09:16.357113 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:373 started Sep 04 01:09:16.361575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5619,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=752000000,duration_sec=765,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:09:16.362142 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:09:16.362503 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:373 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 04 01:09:18.358073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:374 started Sep 04 01:09:18.360760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade561b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=752000000,duration_sec=767,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:09:18.361786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:09:18.367429 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:374 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:09:20.358917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:375 started Sep 04 01:09:20.362155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade561d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=753000000,duration_sec=769,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:09:20.362723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:09:20.363082 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:375 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:09:21.558942 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-8a6aab44-8987-4354-b15c-69b6c7d4e484 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Resource Port deleted: 610a3f9e-176f-46b6-82d0-90b3e3651b7b {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:09:21.559837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-8a6aab44-8987-4354-b15c-69b6c7d4e484 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (610a3f9e-176f-46b6-82d0-90b3e3651b7b), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:09:21.560249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-8a6aab44-8987-4354-b15c-69b6c7d4e484 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Security group member updated {'442c2a6c-c343-4c57-b096-17650925c895'} Sep 04 01:09:22.360374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:376 started Sep 04 01:09:22.364911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade561f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=756000000,duration_sec=771,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:09:22.366999 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:09:22.368408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:376 - starting polling. Elapsed:0.007 Sep 04 01:09:22.390430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:09:22.397520 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 610a3f9e-176f-46b6-82d0-90b3e3651b7b not present in bridge br-int Sep 04 01:09:22.397862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] net_uuid None not managed by VLAN manager Sep 04 01:09:22.403538 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for ['610a3f9e-176f-46b6-82d0-90b3e3651b7b'] Sep 04 01:09:22.405126 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 610a3f9e-176f-46b6-82d0-90b3e3651b7b is not handled by the firewall. {{(pid=107812) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 04 01:09:22.414361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:376 - port information retrieved. Elapsed:0.054 Sep 04 01:09:22.414706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:376 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.055 Sep 04 01:09:22.488613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-87d27ceb-dcd7-44c8-a4ec-d4367410a1e9 tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:09:21Z,data_plane_status=None,description='',device_id='74df11dc-31bd-4745-83bc-4b3c430d02ff',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=d072bfcf-41bd-430e-800c-1d1a3b17d915,mac_address=fa:16:3e:a8:02:98,name='',network_id=a4020194-c9cd-46d3-9c56-5d8c215c248f,numa_affinity_policy=,project_id='735896cd6b3b4c448dd94b3bf7577cb8',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(d072bfcf-41bd-430e-800c-1d1a3b17d915),security_group_ids=set([270d62da-5350-44de-9262-a4399d8651e3]),status='DOWN',updated_at=2022-09-04T01:09:21Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:09:22.489039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-87d27ceb-dcd7-44c8-a4ec-d4367410a1e9 tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (d072bfcf-41bd-430e-800c-1d1a3b17d915), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:09:22.489856 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-87d27ceb-dcd7-44c8-a4ec-d4367410a1e9 tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] Security group member updated {'270d62da-5350-44de-9262-a4399d8651e3'} Sep 04 01:09:23.649216 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-879927bc-c172-48fe-83f0-062a89e15c42 service neutron] Resource Port d072bfcf-41bd-430e-800c-1d1a3b17d915 updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=d072bfcf-41bd-430e-800c-1d1a3b17d915,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=d072bfcf-41bd-430e-800c-1d1a3b17d915,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:09:23.649820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-879927bc-c172-48fe-83f0-062a89e15c42 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (d072bfcf-41bd-430e-800c-1d1a3b17d915), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:09:23.896260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-3221b36a-3c12-4fab-b8d3-6bdbcba2c02f admin admin] Resource Subnet deleted: 1715ca4f-993d-4984-97fb-84481d321a38 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:09:23.896991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-3221b36a-3c12-4fab-b8d3-6bdbcba2c02f admin admin] Publish callbacks [] for Subnet (1715ca4f-993d-4984-97fb-84481d321a38), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:09:24.116274 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-879927bc-c172-48fe-83f0-062a89e15c42 service neutron] Resource Port d072bfcf-41bd-430e-800c-1d1a3b17d915 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=d072bfcf-41bd-430e-800c-1d1a3b17d915,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=d072bfcf-41bd-430e-800c-1d1a3b17d915,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=d072bfcf-41bd-430e-800c-1d1a3b17d915,segment=NetworkSegment(7f3c23b7-4619-4de8-89fe-789a39101159),segment_id=7f3c23b7-4619-4de8-89fe-789a39101159)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:09:24.116744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-879927bc-c172-48fe-83f0-062a89e15c42 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (d072bfcf-41bd-430e-800c-1d1a3b17d915), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:09:24.361188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:377 started Sep 04 01:09:24.364131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5621,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=755000000,duration_sec=773,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:09:24.364702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:09:24.365040 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:377 - starting polling. Elapsed:0.004 Sep 04 01:09:24.369133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:09:24.373418 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:377 - port information retrieved. Elapsed:0.012 Sep 04 01:09:24.373418 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:377 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Sep 04 01:09:24.447948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-9cfbd483-d8e3-4a01-9ada-7af378d210c6 admin admin] Resource Network deleted: 7e04f73d-bad8-4860-94c2-08b2d4e17fa9 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:09:24.448396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-9cfbd483-d8e3-4a01-9ada-7af378d210c6 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533'] for Network (7e04f73d-bad8-4860-94c2-08b2d4e17fa9), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:09:24.615049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c2a84d40-da1f-4be6-9736-34c26b77dbc6 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Resource SecurityGroup deleted: 442c2a6c-c343-4c57-b096-17650925c895 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:09:24.616633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-c2a84d40-da1f-4be6-9736-34c26b77dbc6 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (442c2a6c-c343-4c57-b096-17650925c895), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:09:24.617318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2a84d40-da1f-4be6-9736-34c26b77dbc6 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('442c2a6c-c343-4c57-b096-17650925c895',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:09:24.633332 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c2a84d40-da1f-4be6-9736-34c26b77dbc6 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('442c2a6c-c343-4c57-b096-17650925c895',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:09:24.633767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c2a84d40-da1f-4be6-9736-34c26b77dbc6 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Resource SecurityGroupRule deleted: 81b03c57-5de6-437b-87f8-8cd2b11fd6a9 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:09:24.634140 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-c2a84d40-da1f-4be6-9736-34c26b77dbc6 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (81b03c57-5de6-437b-87f8-8cd2b11fd6a9), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:09:24.634474 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-c2a84d40-da1f-4be6-9736-34c26b77dbc6 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Security group rule updated ['442c2a6c-c343-4c57-b096-17650925c895'] Sep 04 01:09:24.635142 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c2a84d40-da1f-4be6-9736-34c26b77dbc6 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Resource SecurityGroupRule deleted: ea3c9c15-91a1-44ab-a2f1-7b7edc4ea5d2 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:09:24.635640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-c2a84d40-da1f-4be6-9736-34c26b77dbc6 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (ea3c9c15-91a1-44ab-a2f1-7b7edc4ea5d2), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:09:24.636134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-c2a84d40-da1f-4be6-9736-34c26b77dbc6 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Security group rule updated ['442c2a6c-c343-4c57-b096-17650925c895'] Sep 04 01:09:24.636826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c2a84d40-da1f-4be6-9736-34c26b77dbc6 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Resource SecurityGroupRule deleted: b41d7505-179a-44cf-8506-73ee1ca8f7ba {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:09:24.637556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-c2a84d40-da1f-4be6-9736-34c26b77dbc6 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (b41d7505-179a-44cf-8506-73ee1ca8f7ba), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:09:24.637911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-c2a84d40-da1f-4be6-9736-34c26b77dbc6 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Security group rule updated ['442c2a6c-c343-4c57-b096-17650925c895'] Sep 04 01:09:24.638592 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c2a84d40-da1f-4be6-9736-34c26b77dbc6 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Resource SecurityGroupRule deleted: 60ad1c79-9439-49a6-b38a-c3e7e4f9433a {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:09:24.638938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-c2a84d40-da1f-4be6-9736-34c26b77dbc6 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (60ad1c79-9439-49a6-b38a-c3e7e4f9433a), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:09:24.639257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-c2a84d40-da1f-4be6-9736-34c26b77dbc6 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Security group rule updated ['442c2a6c-c343-4c57-b096-17650925c895'] Sep 04 01:09:25.119699 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0e362cd0-24f1-4ebf-85a1-e819b4594716 admin admin] Resource SecurityGroup deleted: 47886e6f-b931-4c89-84ae-31a8725f8d25 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:09:25.120327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-0e362cd0-24f1-4ebf-85a1-e819b4594716 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (47886e6f-b931-4c89-84ae-31a8725f8d25), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:09:25.120793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e362cd0-24f1-4ebf-85a1-e819b4594716 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('47886e6f-b931-4c89-84ae-31a8725f8d25',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:09:25.138049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0e362cd0-24f1-4ebf-85a1-e819b4594716 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('47886e6f-b931-4c89-84ae-31a8725f8d25',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:09:25.139076 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0e362cd0-24f1-4ebf-85a1-e819b4594716 admin admin] Resource SecurityGroupRule deleted: 188cdfd3-71c3-4778-914a-172fe6073a2e {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:09:25.139827 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-0e362cd0-24f1-4ebf-85a1-e819b4594716 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (188cdfd3-71c3-4778-914a-172fe6073a2e), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:09:25.140824 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-0e362cd0-24f1-4ebf-85a1-e819b4594716 admin admin] Security group rule updated ['47886e6f-b931-4c89-84ae-31a8725f8d25'] Sep 04 01:09:25.141511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0e362cd0-24f1-4ebf-85a1-e819b4594716 admin admin] Resource SecurityGroupRule deleted: 6828446d-9807-4a73-adb3-e47e2751c59f {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:09:25.142473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-0e362cd0-24f1-4ebf-85a1-e819b4594716 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (6828446d-9807-4a73-adb3-e47e2751c59f), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:09:25.143001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-0e362cd0-24f1-4ebf-85a1-e819b4594716 admin admin] Security group rule updated ['47886e6f-b931-4c89-84ae-31a8725f8d25'] Sep 04 01:09:25.143804 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0e362cd0-24f1-4ebf-85a1-e819b4594716 admin admin] Resource SecurityGroupRule deleted: 852b00e5-4c60-48b0-92af-c39bd15eb248 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:09:25.144320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-0e362cd0-24f1-4ebf-85a1-e819b4594716 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (852b00e5-4c60-48b0-92af-c39bd15eb248), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:09:25.144892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-0e362cd0-24f1-4ebf-85a1-e819b4594716 admin admin] Security group rule updated ['47886e6f-b931-4c89-84ae-31a8725f8d25'] Sep 04 01:09:25.145447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0e362cd0-24f1-4ebf-85a1-e819b4594716 admin admin] Resource SecurityGroupRule deleted: aeae4815-f7ab-4fc2-9e89-a19929ca73cb {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:09:25.145990 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-0e362cd0-24f1-4ebf-85a1-e819b4594716 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (aeae4815-f7ab-4fc2-9e89-a19929ca73cb), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:09:25.146404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-0e362cd0-24f1-4ebf-85a1-e819b4594716 admin admin] Security group rule updated ['47886e6f-b931-4c89-84ae-31a8725f8d25'] Sep 04 01:09:25.328361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-7db00479-54d3-48f4-bae3-b44d58d5d533 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Resource Port deleted: 21a78bab-8f3d-44c4-86b7-043c859432b9 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:09:25.329311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-7db00479-54d3-48f4-bae3-b44d58d5d533 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (21a78bab-8f3d-44c4-86b7-043c859432b9), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:09:26.361643 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:378 started Sep 04 01:09:26.364315 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5623,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=756000000,duration_sec=775,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:09:26.364967 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:09:26.365969 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:378 - starting polling. Elapsed:0.004 Sep 04 01:09:26.368926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:09:26.370915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 21a78bab-8f3d-44c4-86b7-043c859432b9 not present in bridge br-int Sep 04 01:09:26.371249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] net_uuid None not managed by VLAN manager Sep 04 01:09:26.371530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for ['21a78bab-8f3d-44c4-86b7-043c859432b9'] Sep 04 01:09:26.371945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 21a78bab-8f3d-44c4-86b7-043c859432b9 is not handled by the firewall. {{(pid=107812) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 04 01:09:26.375934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:378 - port information retrieved. Elapsed:0.014 Sep 04 01:09:26.376257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:378 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.015 Sep 04 01:09:28.362629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:379 started Sep 04 01:09:28.365109 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5625,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=757000000,duration_sec=777,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:09:28.366231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:09:28.366576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:379 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:09:30.364042 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:380 started Sep 04 01:09:30.367408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5627,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=758000000,duration_sec=779,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:09:30.367981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:09:30.368326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:380 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:09:30.637698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-7e28fe6a-aede-4beb-8415-acf272e8b759 tempest-VolumesSnapshotTestJSON-1378097567 tempest-VolumesSnapshotTestJSON-1378097567-project] Resource Port deleted: 88ae446d-0ce0-4187-b028-5915cabba54c {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:09:30.638083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-7e28fe6a-aede-4beb-8415-acf272e8b759 tempest-VolumesSnapshotTestJSON-1378097567 tempest-VolumesSnapshotTestJSON-1378097567-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (88ae446d-0ce0-4187-b028-5915cabba54c), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:09:30.638528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-7e28fe6a-aede-4beb-8415-acf272e8b759 tempest-VolumesSnapshotTestJSON-1378097567 tempest-VolumesSnapshotTestJSON-1378097567-project] Security group member updated {'dd251723-c6f9-4e67-b522-e38b91c2bfeb'} Sep 04 01:09:32.366229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:381 started Sep 04 01:09:32.368679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5629,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=760000000,duration_sec=781,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:09:32.369451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:09:32.369789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:381 - starting polling. Elapsed:0.004 Sep 04 01:09:32.372851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:09:32.374815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 88ae446d-0ce0-4187-b028-5915cabba54c not present in bridge br-int Sep 04 01:09:32.375149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] net_uuid None not managed by VLAN manager Sep 04 01:09:32.375431 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for ['88ae446d-0ce0-4187-b028-5915cabba54c'] Sep 04 01:09:32.375748 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 88ae446d-0ce0-4187-b028-5915cabba54c is not handled by the firewall. {{(pid=107812) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 04 01:09:32.379575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:381 - port information retrieved. Elapsed:0.014 Sep 04 01:09:32.379904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:381 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.014 Sep 04 01:09:34.366943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:382 started Sep 04 01:09:34.369411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade562b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=761000000,duration_sec=783,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:09:34.369967 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:09:34.370339 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:382 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:09:34.758857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-f1095cce-76eb-4860-b930-bf5e696783d0 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Resource Port deleted: e0a049e7-02dc-4e07-af75-3de7fbe36b23 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:09:34.760926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-f1095cce-76eb-4860-b930-bf5e696783d0 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (e0a049e7-02dc-4e07-af75-3de7fbe36b23), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:09:34.760926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-f1095cce-76eb-4860-b930-bf5e696783d0 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Security group member updated {'f1cdaab5-9805-40c3-b794-76bf42b9b813'} Sep 04 01:09:36.368405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:383 started Sep 04 01:09:36.370824 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade562d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=762000000,duration_sec=785,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:09:36.371379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:09:36.371707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:383 - starting polling. Elapsed:0.003 Sep 04 01:09:36.374519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:09:36.376473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port e0a049e7-02dc-4e07-af75-3de7fbe36b23 not present in bridge br-int Sep 04 01:09:36.376801 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] net_uuid None not managed by VLAN manager Sep 04 01:09:36.377103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for ['e0a049e7-02dc-4e07-af75-3de7fbe36b23'] Sep 04 01:09:36.377422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port e0a049e7-02dc-4e07-af75-3de7fbe36b23 is not handled by the firewall. {{(pid=107812) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 04 01:09:36.381760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:383 - port information retrieved. Elapsed:0.014 Sep 04 01:09:36.382086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:383 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.014 Sep 04 01:09:38.370027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:384 started Sep 04 01:09:38.372370 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade562f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=764000000,duration_sec=787,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:09:38.372929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:09:38.373309 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:384 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:09:40.371399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:385 started Sep 04 01:09:40.374563 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5631,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=766000000,duration_sec=789,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:09:40.375158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:09:40.375511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:385 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:09:41.085040 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Resource Port d072bfcf-41bd-430e-800c-1d1a3b17d915 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:09:41.085040 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (d072bfcf-41bd-430e-800c-1d1a3b17d915), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:09:42.372005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:386 started Sep 04 01:09:42.375813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5633,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=766000000,duration_sec=791,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:09:42.375813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:09:42.376074 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:386 - starting polling. Elapsed:0.004 Sep 04 01:09:42.379085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:09:42.386022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:386 - port information retrieved. Elapsed:0.014 Sep 04 01:09:42.386760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:386 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.015 Sep 04 01:09:42.671657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-a6f88de5-e2eb-4a12-9fbc-67bd07206034 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Resource SecurityGroup deleted: f1cdaab5-9805-40c3-b794-76bf42b9b813 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:09:42.672038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-a6f88de5-e2eb-4a12-9fbc-67bd07206034 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (f1cdaab5-9805-40c3-b794-76bf42b9b813), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:09:42.672497 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6f88de5-e2eb-4a12-9fbc-67bd07206034 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('f1cdaab5-9805-40c3-b794-76bf42b9b813',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:09:42.686968 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-a6f88de5-e2eb-4a12-9fbc-67bd07206034 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('f1cdaab5-9805-40c3-b794-76bf42b9b813',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:09:42.687153 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-a6f88de5-e2eb-4a12-9fbc-67bd07206034 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Resource SecurityGroupRule deleted: 199678bd-948c-4ce5-98d9-032a3b3e056e {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:09:42.687527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-a6f88de5-e2eb-4a12-9fbc-67bd07206034 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (199678bd-948c-4ce5-98d9-032a3b3e056e), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:09:42.687862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-a6f88de5-e2eb-4a12-9fbc-67bd07206034 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Security group rule updated ['f1cdaab5-9805-40c3-b794-76bf42b9b813'] Sep 04 01:09:42.688298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-a6f88de5-e2eb-4a12-9fbc-67bd07206034 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Resource SecurityGroupRule deleted: f3493799-7a1a-420f-9df2-99beea0201b4 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:09:42.688641 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-a6f88de5-e2eb-4a12-9fbc-67bd07206034 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (f3493799-7a1a-420f-9df2-99beea0201b4), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:09:42.689111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-a6f88de5-e2eb-4a12-9fbc-67bd07206034 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Security group rule updated ['f1cdaab5-9805-40c3-b794-76bf42b9b813'] Sep 04 01:09:42.689562 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-a6f88de5-e2eb-4a12-9fbc-67bd07206034 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Resource SecurityGroupRule deleted: 8007b0e1-b652-4ead-a980-dd8e3248e4ab {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:09:42.690195 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-a6f88de5-e2eb-4a12-9fbc-67bd07206034 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (8007b0e1-b652-4ead-a980-dd8e3248e4ab), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:09:42.690513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-a6f88de5-e2eb-4a12-9fbc-67bd07206034 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Security group rule updated ['f1cdaab5-9805-40c3-b794-76bf42b9b813'] Sep 04 01:09:42.690926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-a6f88de5-e2eb-4a12-9fbc-67bd07206034 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Resource SecurityGroupRule deleted: be54aecb-bdaa-40b9-948a-c685064958fc {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:09:42.691262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-a6f88de5-e2eb-4a12-9fbc-67bd07206034 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (be54aecb-bdaa-40b9-948a-c685064958fc), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:09:42.691580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-a6f88de5-e2eb-4a12-9fbc-67bd07206034 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Security group rule updated ['f1cdaab5-9805-40c3-b794-76bf42b9b813'] Sep 04 01:09:43.151592 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Resource Port d072bfcf-41bd-430e-800c-1d1a3b17d915 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:09:43.151975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (d072bfcf-41bd-430e-800c-1d1a3b17d915), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:09:43.154768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-cc472e55-2d07-4f17-9912-d59a46df1a25 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Resource Port deleted: 498a0a31-5c9a-4552-a9dd-f3487791491b {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:09:43.159705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-cc472e55-2d07-4f17-9912-d59a46df1a25 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (498a0a31-5c9a-4552-a9dd-f3487791491b), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:09:43.670657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c4de4ed5-8141-45c1-8bcb-62fc1edd289c tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:09:43Z,description='tempest-description--1353750241',id=3188d55b-e58c-4649-bc32-63a6cf0b7421,is_default=False,name='tempest-securitygroup--1895800531',project_id='287d111f08ac4b05bd5adec9c40d0620',revision_number=1,rules=[SecurityGroupRule(1cc89abb-3123-4596-b9b5-f96fb43e4968),SecurityGroupRule(cab1aada-d372-46c9-8292-c25ea928acfd)],shared=False,stateful=True,updated_at=2022-09-04T01:09:43Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:09:43.671292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-c4de4ed5-8141-45c1-8bcb-62fc1edd289c tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (3188d55b-e58c-4649-bc32-63a6cf0b7421), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:09:43.671634 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c4de4ed5-8141-45c1-8bcb-62fc1edd289c tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:09:43Z,description=,direction='egress',ethertype='IPv4',id=1cc89abb-3123-4596-b9b5-f96fb43e4968,normalized_cidr=None,port_range_max=,port_range_min=,project_id='287d111f08ac4b05bd5adec9c40d0620',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=3188d55b-e58c-4649-bc32-63a6cf0b7421,updated_at=2022-09-04T01:09:43Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:09:43.671992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-c4de4ed5-8141-45c1-8bcb-62fc1edd289c tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (1cc89abb-3123-4596-b9b5-f96fb43e4968), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:09:43.672327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-c4de4ed5-8141-45c1-8bcb-62fc1edd289c tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Security group rule updated ['3188d55b-e58c-4649-bc32-63a6cf0b7421'] Sep 04 01:09:43.673155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c4de4ed5-8141-45c1-8bcb-62fc1edd289c tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:09:43Z,description=,direction='egress',ethertype='IPv6',id=cab1aada-d372-46c9-8292-c25ea928acfd,normalized_cidr=None,port_range_max=,port_range_min=,project_id='287d111f08ac4b05bd5adec9c40d0620',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=3188d55b-e58c-4649-bc32-63a6cf0b7421,updated_at=2022-09-04T01:09:43Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:09:43.673534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-c4de4ed5-8141-45c1-8bcb-62fc1edd289c tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (cab1aada-d372-46c9-8292-c25ea928acfd), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:09:43.673851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-c4de4ed5-8141-45c1-8bcb-62fc1edd289c tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Security group rule updated ['3188d55b-e58c-4649-bc32-63a6cf0b7421'] Sep 04 01:09:43.947006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-a331ed70-ee3b-4414-995a-5471f3d90aaa tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:09:43Z,description='',direction='ingress',ethertype='IPv4',id=6ce442c2-88cc-4ad9-b194-f4cde28e076f,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='287d111f08ac4b05bd5adec9c40d0620',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=3188d55b-e58c-4649-bc32-63a6cf0b7421,updated_at=2022-09-04T01:09:43Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:09:43.947412 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-a331ed70-ee3b-4414-995a-5471f3d90aaa tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (6ce442c2-88cc-4ad9-b194-f4cde28e076f), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:09:43.947756 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-a331ed70-ee3b-4414-995a-5471f3d90aaa tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Security group rule updated ['3188d55b-e58c-4649-bc32-63a6cf0b7421'] Sep 04 01:09:44.238749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-bbe802b1-1b26-4e28-810e-3a9982c6ddac tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:09:44Z,description='',direction='ingress',ethertype='IPv4',id=da25d770-7f7b-471c-90da-935d3bac1d1d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='287d111f08ac4b05bd5adec9c40d0620',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=3188d55b-e58c-4649-bc32-63a6cf0b7421,updated_at=2022-09-04T01:09:44Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:09:44.239130 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-bbe802b1-1b26-4e28-810e-3a9982c6ddac tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (da25d770-7f7b-471c-90da-935d3bac1d1d), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:09:44.239503 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-bbe802b1-1b26-4e28-810e-3a9982c6ddac tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Security group rule updated ['3188d55b-e58c-4649-bc32-63a6cf0b7421'] Sep 04 01:09:44.373277 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:387 started Sep 04 01:09:44.375700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5635,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=767000000,duration_sec=793,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:09:44.376267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:09:44.376601 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:387 - starting polling. Elapsed:0.004 Sep 04 01:09:44.379421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:09:44.381697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 498a0a31-5c9a-4552-a9dd-f3487791491b not present in bridge br-int Sep 04 01:09:44.382035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] net_uuid None not managed by VLAN manager Sep 04 01:09:44.382345 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for ['498a0a31-5c9a-4552-a9dd-f3487791491b'] Sep 04 01:09:44.382664 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 498a0a31-5c9a-4552-a9dd-f3487791491b is not handled by the firewall. {{(pid=107812) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 04 01:09:44.386462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:387 - port information retrieved. Elapsed:0.013 Sep 04 01:09:44.386789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:387 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.014 Sep 04 01:09:45.275333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-ea6ea9ba-2dce-4e9c-9f9c-3637afd34453 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:09:44Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=4a09384c-90bb-4ec0-9852-30a5a35f5dc0,mac_address=fa:16:3e:c5:ae:02,name='',network_id=e8e0564a-d5c9-4fe0-b2d4-538f45096708,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(4a09384c-90bb-4ec0-9852-30a5a35f5dc0),security_group_ids=set([]),status='N/A',updated_at=2022-09-04T01:09:45Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:09:45.275965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-ea6ea9ba-2dce-4e9c-9f9c-3637afd34453 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (4a09384c-90bb-4ec0-9852-30a5a35f5dc0), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:09:45.755051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-ea6ea9ba-2dce-4e9c-9f9c-3637afd34453 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Resource Port 4a09384c-90bb-4ec0-9852-30a5a35f5dc0 updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': '8e900505-469e-4629-989e-5ded8065c2a0'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:09:45.755435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-ea6ea9ba-2dce-4e9c-9f9c-3637afd34453 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (4a09384c-90bb-4ec0-9852-30a5a35f5dc0), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:09:46.374241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:388 started Sep 04 01:09:46.376925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5637,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=768000000,duration_sec=795,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:09:46.377666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:09:46.378099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:388 - starting polling. Elapsed:0.004 Sep 04 01:09:46.381454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:09:46.385638 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:388 - port information retrieved. Elapsed:0.012 Sep 04 01:09:46.386046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:388 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Sep 04 01:09:47.221153 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-16b3536b-adae-4e50-9f82-9d58042295cf tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:09:46Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=3a4abfa2-c334-4497-99bc-b98bb52855e4,mac_address=fa:16:3e:b2:ff:c0,name='',network_id=e8e0564a-d5c9-4fe0-b2d4-538f45096708,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(3a4abfa2-c334-4497-99bc-b98bb52855e4),security_group_ids=set([]),status='N/A',updated_at=2022-09-04T01:09:46Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:09:47.221538 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-16b3536b-adae-4e50-9f82-9d58042295cf tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (3a4abfa2-c334-4497-99bc-b98bb52855e4), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:09:47.922782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-16b3536b-adae-4e50-9f82-9d58042295cf tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] Resource Port 3a4abfa2-c334-4497-99bc-b98bb52855e4 updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': '047553b0-03ec-425b-ab53-396fc0149aa8'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:09:47.924018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-16b3536b-adae-4e50-9f82-9d58042295cf tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (3a4abfa2-c334-4497-99bc-b98bb52855e4), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:09:48.375453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:389 started Sep 04 01:09:48.380281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5639,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=770000000,duration_sec=797,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:09:48.387067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:09:48.387067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:389 - starting polling. Elapsed:0.007 Sep 04 01:09:48.387067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:09:48.390642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:389 - port information retrieved. Elapsed:0.015 Sep 04 01:09:48.390977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:389 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.016 Sep 04 01:09:50.376502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:390 started Sep 04 01:09:50.379894 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade563b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=771000000,duration_sec=799,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:09:50.380734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:09:50.381235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:390 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 04 01:09:51.164560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-a9408ece-b7e1-438f-ba91-39925c6ed8de tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:09:50Z,data_plane_status=None,description='',device_id='16b0498f-4cb8-491a-92cf-dac9890c7b4a',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=2aad8c1f-5af7-4478-b2c4-782e5042cc6b,mac_address=fa:16:3e:1e:80:11,name='',network_id=d7f39628-666e-4480-8bee-49de183d5e09,numa_affinity_policy=,project_id='287d111f08ac4b05bd5adec9c40d0620',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(2aad8c1f-5af7-4478-b2c4-782e5042cc6b),security_group_ids=set([3188d55b-e58c-4649-bc32-63a6cf0b7421]),status='DOWN',updated_at=2022-09-04T01:09:50Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:09:51.165476 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-a9408ece-b7e1-438f-ba91-39925c6ed8de tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (2aad8c1f-5af7-4478-b2c4-782e5042cc6b), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:09:51.166335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-a9408ece-b7e1-438f-ba91-39925c6ed8de tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Security group member updated {'3188d55b-e58c-4649-bc32-63a6cf0b7421'} Sep 04 01:09:51.998644 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-af536a14-946c-4249-99dc-7950b4375517 service neutron] Resource Port 2aad8c1f-5af7-4478-b2c4-782e5042cc6b updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=2aad8c1f-5af7-4478-b2c4-782e5042cc6b,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=2aad8c1f-5af7-4478-b2c4-782e5042cc6b,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:09:51.999288 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-af536a14-946c-4249-99dc-7950b4375517 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (2aad8c1f-5af7-4478-b2c4-782e5042cc6b), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:09:52.283019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-af536a14-946c-4249-99dc-7950b4375517 service neutron] Resource Port 2aad8c1f-5af7-4478-b2c4-782e5042cc6b updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=2aad8c1f-5af7-4478-b2c4-782e5042cc6b,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=2aad8c1f-5af7-4478-b2c4-782e5042cc6b,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=2aad8c1f-5af7-4478-b2c4-782e5042cc6b,segment=NetworkSegment(929a573e-75ef-46ab-9889-4a31869bd81c),segment_id=929a573e-75ef-46ab-9889-4a31869bd81c)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:09:52.283400 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-af536a14-946c-4249-99dc-7950b4375517 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (2aad8c1f-5af7-4478-b2c4-782e5042cc6b), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:09:52.377772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:391 started Sep 04 01:09:52.380367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade563d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=772000000,duration_sec=801,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:09:52.381757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:09:52.382181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:391 - starting polling. Elapsed:0.004 Sep 04 01:09:52.385129 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:09:52.395048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:391 - port information retrieved. Elapsed:0.011 Sep 04 01:09:52.395048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:391 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Sep 04 01:09:54.378537 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:392 started Sep 04 01:09:54.382387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade563f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=773000000,duration_sec=803,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:09:54.383001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:09:54.383359 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:392 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 04 01:09:54.472615 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-e7ca183c-0c73-418b-b5fe-2bebfdb6b268 tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Resource Port deleted: fcbc60fd-1785-4f94-9436-a520ec06cdaf {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:09:54.473467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-e7ca183c-0c73-418b-b5fe-2bebfdb6b268 tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (fcbc60fd-1785-4f94-9436-a520ec06cdaf), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:09:54.473888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-e7ca183c-0c73-418b-b5fe-2bebfdb6b268 tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Security group member updated {'28889e15-3fb7-44d1-a902-1d3272393b5a'} Sep 04 01:09:56.379735 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:393 started Sep 04 01:09:56.384233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5641,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=774000000,duration_sec=805,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:09:56.385064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:09:56.385426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:393 - starting polling. Elapsed:0.006 Sep 04 01:09:56.388623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:09:56.391623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port fcbc60fd-1785-4f94-9436-a520ec06cdaf not present in bridge br-int Sep 04 01:09:56.391947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] net_uuid None not managed by VLAN manager Sep 04 01:09:56.392232 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for ['fcbc60fd-1785-4f94-9436-a520ec06cdaf'] Sep 04 01:09:56.392739 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port fcbc60fd-1785-4f94-9436-a520ec06cdaf is not handled by the firewall. {{(pid=107812) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 04 01:09:56.396861 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:393 - port information retrieved. Elapsed:0.017 Sep 04 01:09:56.397232 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:393 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.018 Sep 04 01:09:57.891707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0929d9d2-cd7b-45a4-a8ac-1872104d16cf tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Resource SecurityGroup deleted: 28889e15-3fb7-44d1-a902-1d3272393b5a {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:09:57.892357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-0929d9d2-cd7b-45a4-a8ac-1872104d16cf tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (28889e15-3fb7-44d1-a902-1d3272393b5a), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:09:57.892745 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0929d9d2-cd7b-45a4-a8ac-1872104d16cf tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('28889e15-3fb7-44d1-a902-1d3272393b5a',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:09:57.911171 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0929d9d2-cd7b-45a4-a8ac-1872104d16cf tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('28889e15-3fb7-44d1-a902-1d3272393b5a',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:09:57.911695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0929d9d2-cd7b-45a4-a8ac-1872104d16cf tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Resource SecurityGroupRule deleted: 4cd47fc4-9c7e-4882-8e3e-890204bcb3f6 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:09:57.912095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-0929d9d2-cd7b-45a4-a8ac-1872104d16cf tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (4cd47fc4-9c7e-4882-8e3e-890204bcb3f6), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:09:57.912492 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-0929d9d2-cd7b-45a4-a8ac-1872104d16cf tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Security group rule updated ['28889e15-3fb7-44d1-a902-1d3272393b5a'] Sep 04 01:09:57.913645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0929d9d2-cd7b-45a4-a8ac-1872104d16cf tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Resource SecurityGroupRule deleted: f32a7105-39c6-4376-9e61-df74bc738a43 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:09:57.914049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-0929d9d2-cd7b-45a4-a8ac-1872104d16cf tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (f32a7105-39c6-4376-9e61-df74bc738a43), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:09:57.914380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-0929d9d2-cd7b-45a4-a8ac-1872104d16cf tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Security group rule updated ['28889e15-3fb7-44d1-a902-1d3272393b5a'] Sep 04 01:09:57.914800 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0929d9d2-cd7b-45a4-a8ac-1872104d16cf tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Resource SecurityGroupRule deleted: 2a82bd6f-bae3-46b9-9d13-e5e21332649f {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:09:57.915168 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-0929d9d2-cd7b-45a4-a8ac-1872104d16cf tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (2a82bd6f-bae3-46b9-9d13-e5e21332649f), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:09:57.915543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-0929d9d2-cd7b-45a4-a8ac-1872104d16cf tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Security group rule updated ['28889e15-3fb7-44d1-a902-1d3272393b5a'] Sep 04 01:09:57.915960 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0929d9d2-cd7b-45a4-a8ac-1872104d16cf tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Resource SecurityGroupRule deleted: 0952f260-02fb-4d4b-b582-b1bd8a8376d3 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:09:57.916308 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-0929d9d2-cd7b-45a4-a8ac-1872104d16cf tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (0952f260-02fb-4d4b-b582-b1bd8a8376d3), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:09:57.916675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-0929d9d2-cd7b-45a4-a8ac-1872104d16cf tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Security group rule updated ['28889e15-3fb7-44d1-a902-1d3272393b5a'] Sep 04 01:09:58.312597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-5623220d-3085-4d71-861f-95fb99163bab tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Resource Port deleted: 5db671be-feec-4d74-8501-0b964112262c {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:09:58.312979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-5623220d-3085-4d71-861f-95fb99163bab tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (5db671be-feec-4d74-8501-0b964112262c), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:09:58.380219 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:394 started Sep 04 01:09:58.384687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5643,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=775000000,duration_sec=807,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:09:58.385783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:09:58.386640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:394 - starting polling. Elapsed:0.006 Sep 04 01:09:58.389692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:09:58.391961 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 5db671be-feec-4d74-8501-0b964112262c not present in bridge br-int Sep 04 01:09:58.392111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] net_uuid None not managed by VLAN manager Sep 04 01:09:58.392505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for ['5db671be-feec-4d74-8501-0b964112262c'] Sep 04 01:09:58.393004 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 5db671be-feec-4d74-8501-0b964112262c is not handled by the firewall. {{(pid=107812) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 04 01:09:58.396734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:394 - port information retrieved. Elapsed:0.017 Sep 04 01:09:58.397925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:394 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.017 Sep 04 01:09:58.775170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-3d6576e1-1dec-4fa4-b60e-edd256f08ac9 tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:09:58Z,description='tempest-description--1211808342',id=5afa6b78-0b8f-45ce-ad51-9baae28be95f,is_default=False,name='tempest-securitygroup--946139031',project_id='55faed42b7f243df9df879d581797f56',revision_number=1,rules=[SecurityGroupRule(32f68641-b96f-455c-8dc7-3bb02423a062),SecurityGroupRule(c0a0377d-abf2-4cdd-8af3-883268f42bc7)],shared=False,stateful=True,updated_at=2022-09-04T01:09:58Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:09:58.775556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-3d6576e1-1dec-4fa4-b60e-edd256f08ac9 tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (5afa6b78-0b8f-45ce-ad51-9baae28be95f), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:09:58.776269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-3d6576e1-1dec-4fa4-b60e-edd256f08ac9 tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:09:58Z,description=,direction='egress',ethertype='IPv4',id=32f68641-b96f-455c-8dc7-3bb02423a062,normalized_cidr=None,port_range_max=,port_range_min=,project_id='55faed42b7f243df9df879d581797f56',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=5afa6b78-0b8f-45ce-ad51-9baae28be95f,updated_at=2022-09-04T01:09:58Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:09:58.776644 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-3d6576e1-1dec-4fa4-b60e-edd256f08ac9 tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (32f68641-b96f-455c-8dc7-3bb02423a062), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:09:58.776976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-3d6576e1-1dec-4fa4-b60e-edd256f08ac9 tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Security group rule updated ['5afa6b78-0b8f-45ce-ad51-9baae28be95f'] Sep 04 01:09:58.777788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-3d6576e1-1dec-4fa4-b60e-edd256f08ac9 tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:09:58Z,description=,direction='egress',ethertype='IPv6',id=c0a0377d-abf2-4cdd-8af3-883268f42bc7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='55faed42b7f243df9df879d581797f56',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=5afa6b78-0b8f-45ce-ad51-9baae28be95f,updated_at=2022-09-04T01:09:58Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:09:58.778151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-3d6576e1-1dec-4fa4-b60e-edd256f08ac9 tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (c0a0377d-abf2-4cdd-8af3-883268f42bc7), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:09:58.778484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-3d6576e1-1dec-4fa4-b60e-edd256f08ac9 tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Security group rule updated ['5afa6b78-0b8f-45ce-ad51-9baae28be95f'] Sep 04 01:09:59.126271 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-f121bf41-d1b4-4fee-a4ee-b43dfd741138 tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:09:58Z,description='',direction='ingress',ethertype='IPv4',id=4de458ba-1eb5-4dd5-841d-d9e7c68344cc,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='55faed42b7f243df9df879d581797f56',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=5afa6b78-0b8f-45ce-ad51-9baae28be95f,updated_at=2022-09-04T01:09:58Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:09:59.126870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-f121bf41-d1b4-4fee-a4ee-b43dfd741138 tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (4de458ba-1eb5-4dd5-841d-d9e7c68344cc), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:09:59.127360 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-f121bf41-d1b4-4fee-a4ee-b43dfd741138 tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Security group rule updated ['5afa6b78-0b8f-45ce-ad51-9baae28be95f'] Sep 04 01:09:59.187351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Resource Port 2aad8c1f-5af7-4478-b2c4-782e5042cc6b updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:09:59.187734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (2aad8c1f-5af7-4478-b2c4-782e5042cc6b), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:09:59.450920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-86a4a798-3fd0-4ba8-bd44-e2c9e76b8630 tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:09:59Z,description='',direction='ingress',ethertype='IPv4',id=7525c5fa-e43a-4f26-b2c1-bfe4a23faa11,normalized_cidr=None,port_range_max=,port_range_min=,project_id='55faed42b7f243df9df879d581797f56',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=5afa6b78-0b8f-45ce-ad51-9baae28be95f,updated_at=2022-09-04T01:09:59Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:09:59.451330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86a4a798-3fd0-4ba8-bd44-e2c9e76b8630 tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (7525c5fa-e43a-4f26-b2c1-bfe4a23faa11), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:09:59.451674 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86a4a798-3fd0-4ba8-bd44-e2c9e76b8630 tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Security group rule updated ['5afa6b78-0b8f-45ce-ad51-9baae28be95f'] Sep 04 01:09:59.984316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-eaf1e485-922c-4527-90e1-dd3f0109be55 admin admin] Resource Subnet deleted: 69d55e63-fdcb-4ee5-a9f8-cb02b9c67f96 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:09:59.984992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-eaf1e485-922c-4527-90e1-dd3f0109be55 admin admin] Publish callbacks [] for Subnet (69d55e63-fdcb-4ee5-a9f8-cb02b9c67f96), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:00.122414 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-22d90291-f415-4fd9-8128-f25e3a3edf4d tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:09:59Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=b89e971b-9f65-44f6-966c-0d2c99d71723,mac_address=fa:16:3e:57:9b:3e,name='',network_id=e8e0564a-d5c9-4fe0-b2d4-538f45096708,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(b89e971b-9f65-44f6-966c-0d2c99d71723),security_group_ids=set([]),status='N/A',updated_at=2022-09-04T01:09:59Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:10:00.123046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-22d90291-f415-4fd9-8128-f25e3a3edf4d tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (b89e971b-9f65-44f6-966c-0d2c99d71723), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:00.382889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:395 started Sep 04 01:10:00.388952 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5645,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=779000000,duration_sec=809,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:10:00.390410 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:10:00.390410 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:395 - starting polling. Elapsed:0.008 Sep 04 01:10:00.393910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:00.399176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:395 - port information retrieved. Elapsed:0.016 Sep 04 01:10:00.399894 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:395 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.017 Sep 04 01:10:00.402553 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-d033e821-4ffa-4f7d-b919-be431a68b052 admin admin] Resource Network deleted: f5f50aa9-3a0d-4b0d-aee8-3b2aef89717d {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:10:00.402967 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-d033e821-4ffa-4f7d-b919-be431a68b052 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533'] for Network (f5f50aa9-3a0d-4b0d-aee8-3b2aef89717d), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:00.641896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-22d90291-f415-4fd9-8128-f25e3a3edf4d tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Resource Port b89e971b-9f65-44f6-966c-0d2c99d71723 updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': 'acb55901-9d85-46a1-aa5b-23f88c8b82f1'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:10:00.642278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-22d90291-f415-4fd9-8128-f25e3a3edf4d tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (b89e971b-9f65-44f6-966c-0d2c99d71723), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:01.110615 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-6b3e3351-6c34-41dc-9b14-90a7e9e6a74d admin admin] Resource SecurityGroup deleted: dd251723-c6f9-4e67-b522-e38b91c2bfeb {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:10:01.111361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-6b3e3351-6c34-41dc-9b14-90a7e9e6a74d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (dd251723-c6f9-4e67-b522-e38b91c2bfeb), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:01.112225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b3e3351-6c34-41dc-9b14-90a7e9e6a74d admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('dd251723-c6f9-4e67-b522-e38b91c2bfeb',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:10:01.130794 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-6b3e3351-6c34-41dc-9b14-90a7e9e6a74d admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('dd251723-c6f9-4e67-b522-e38b91c2bfeb',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:10:01.133217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-6b3e3351-6c34-41dc-9b14-90a7e9e6a74d admin admin] Resource SecurityGroupRule deleted: 0ab4d151-33b1-4937-ae4d-6d1a414b66b4 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:10:01.133217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-6b3e3351-6c34-41dc-9b14-90a7e9e6a74d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (0ab4d151-33b1-4937-ae4d-6d1a414b66b4), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:01.133217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-6b3e3351-6c34-41dc-9b14-90a7e9e6a74d admin admin] Security group rule updated ['dd251723-c6f9-4e67-b522-e38b91c2bfeb'] Sep 04 01:10:01.133639 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-6b3e3351-6c34-41dc-9b14-90a7e9e6a74d admin admin] Resource SecurityGroupRule deleted: 5f784496-788e-4942-a57b-f0e3acc22c85 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:10:01.133775 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-6b3e3351-6c34-41dc-9b14-90a7e9e6a74d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (5f784496-788e-4942-a57b-f0e3acc22c85), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:01.134105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-6b3e3351-6c34-41dc-9b14-90a7e9e6a74d admin admin] Security group rule updated ['dd251723-c6f9-4e67-b522-e38b91c2bfeb'] Sep 04 01:10:01.134525 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-6b3e3351-6c34-41dc-9b14-90a7e9e6a74d admin admin] Resource SecurityGroupRule deleted: e8630b35-2e93-409a-9b8d-749cc25f02b9 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:10:01.134872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-6b3e3351-6c34-41dc-9b14-90a7e9e6a74d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (e8630b35-2e93-409a-9b8d-749cc25f02b9), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:01.135196 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-6b3e3351-6c34-41dc-9b14-90a7e9e6a74d admin admin] Security group rule updated ['dd251723-c6f9-4e67-b522-e38b91c2bfeb'] Sep 04 01:10:01.135614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-6b3e3351-6c34-41dc-9b14-90a7e9e6a74d admin admin] Resource SecurityGroupRule deleted: fd742f91-3526-4a99-b715-3c944dfde89f {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:10:01.135959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-6b3e3351-6c34-41dc-9b14-90a7e9e6a74d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (fd742f91-3526-4a99-b715-3c944dfde89f), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:01.136286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-6b3e3351-6c34-41dc-9b14-90a7e9e6a74d admin admin] Security group rule updated ['dd251723-c6f9-4e67-b522-e38b91c2bfeb'] Sep 04 01:10:01.262082 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Resource Port 2aad8c1f-5af7-4478-b2c4-782e5042cc6b updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:10:01.262468 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (2aad8c1f-5af7-4478-b2c4-782e5042cc6b), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:02.384143 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:396 started Sep 04 01:10:02.386613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5647,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=778000000,duration_sec=811,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:10:02.387197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:10:02.387507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:396 - starting polling. Elapsed:0.004 Sep 04 01:10:02.390412 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:02.394293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:396 - port information retrieved. Elapsed:0.010 Sep 04 01:10:02.394631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:396 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 04 01:10:04.385338 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:397 started Sep 04 01:10:04.387691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5649,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=779000000,duration_sec=813,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:10:04.388296 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:10:04.388640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:397 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:10:06.390581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:398 started Sep 04 01:10:06.393333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade564b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=785000000,duration_sec=815,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:10:06.394249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:10:06.394796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:398 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 04 01:10:08.176714 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-76c64c60-3c5d-41f9-b9ec-e5ff9b2779d1 tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:10:07Z,data_plane_status=None,description='',device_id='da1d8cad-5ea0-48fc-a5af-81eec3d1e94b',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=19f203f1-14db-4bb0-aaad-c8e57c75d249,mac_address=fa:16:3e:ff:4b:2a,name='',network_id=3e702e6e-ebe1-46a7-b30d-f3d140ac2993,numa_affinity_policy=,project_id='55faed42b7f243df9df879d581797f56',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(19f203f1-14db-4bb0-aaad-c8e57c75d249),security_group_ids=set([5afa6b78-0b8f-45ce-ad51-9baae28be95f]),status='DOWN',updated_at=2022-09-04T01:10:07Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:10:08.177441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-76c64c60-3c5d-41f9-b9ec-e5ff9b2779d1 tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (19f203f1-14db-4bb0-aaad-c8e57c75d249), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:08.177686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-76c64c60-3c5d-41f9-b9ec-e5ff9b2779d1 tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Security group member updated {'5afa6b78-0b8f-45ce-ad51-9baae28be95f'} Sep 04 01:10:08.387227 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:399 started Sep 04 01:10:08.390334 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade564d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=782000000,duration_sec=817,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:10:08.391139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:10:08.391635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:399 - starting polling. Elapsed:0.005 Sep 04 01:10:08.395108 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:08.403796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:399 - port information retrieved. Elapsed:0.016 Sep 04 01:10:08.403796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:399 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.016 Sep 04 01:10:08.587214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-25ea1521-401d-4bde-b0fa-9a79628838bd tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Resource Port deleted: e9c83c9b-f295-4069-84cf-ff7c294ae4cd {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:10:08.587399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-25ea1521-401d-4bde-b0fa-9a79628838bd tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (e9c83c9b-f295-4069-84cf-ff7c294ae4cd), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:08.587762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-25ea1521-401d-4bde-b0fa-9a79628838bd tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Security group member updated {'2a5bcd08-2f5c-4785-8968-f136b0051d59'} Sep 04 01:10:08.805816 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-69679134-bdb7-4e93-a4c3-bdb65c4d8fdf service neutron] Resource Port 19f203f1-14db-4bb0-aaad-c8e57c75d249 updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=19f203f1-14db-4bb0-aaad-c8e57c75d249,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=19f203f1-14db-4bb0-aaad-c8e57c75d249,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:10:08.806491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-69679134-bdb7-4e93-a4c3-bdb65c4d8fdf service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (19f203f1-14db-4bb0-aaad-c8e57c75d249), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:09.093164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-69679134-bdb7-4e93-a4c3-bdb65c4d8fdf service neutron] Resource Port 19f203f1-14db-4bb0-aaad-c8e57c75d249 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=19f203f1-14db-4bb0-aaad-c8e57c75d249,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=19f203f1-14db-4bb0-aaad-c8e57c75d249,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=19f203f1-14db-4bb0-aaad-c8e57c75d249,segment=NetworkSegment(294bd754-f77e-4dd5-a8a8-fa66c41ba024),segment_id=294bd754-f77e-4dd5-a8a8-fa66c41ba024)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:10:09.094896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-69679134-bdb7-4e93-a4c3-bdb65c4d8fdf service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (19f203f1-14db-4bb0-aaad-c8e57c75d249), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:10.388334 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:400 started Sep 04 01:10:10.391618 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade564f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=783000000,duration_sec=819,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:10:10.392338 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:10:10.392709 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:400 - starting polling. Elapsed:0.004 Sep 04 01:10:10.396453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:10.410148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port e9c83c9b-f295-4069-84cf-ff7c294ae4cd not present in bridge br-int Sep 04 01:10:10.410148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] net_uuid None not managed by VLAN manager Sep 04 01:10:10.410148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for ['e9c83c9b-f295-4069-84cf-ff7c294ae4cd'] Sep 04 01:10:10.410148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port e9c83c9b-f295-4069-84cf-ff7c294ae4cd is not handled by the firewall. {{(pid=107812) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 04 01:10:10.410148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:400 - port information retrieved. Elapsed:0.016 Sep 04 01:10:10.410148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:400 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.017 Sep 04 01:10:11.483944 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-ce51715d-5ec3-4700-bfb7-6511eea43fdb tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Resource SecurityGroup deleted: 2a5bcd08-2f5c-4785-8968-f136b0051d59 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:10:11.484591 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-ce51715d-5ec3-4700-bfb7-6511eea43fdb tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (2a5bcd08-2f5c-4785-8968-f136b0051d59), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:11.485168 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce51715d-5ec3-4700-bfb7-6511eea43fdb tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('2a5bcd08-2f5c-4785-8968-f136b0051d59',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:10:11.504349 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-ce51715d-5ec3-4700-bfb7-6511eea43fdb tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('2a5bcd08-2f5c-4785-8968-f136b0051d59',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:10:11.504861 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-ce51715d-5ec3-4700-bfb7-6511eea43fdb tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Resource SecurityGroupRule deleted: 8951d6af-0c63-4ed3-b500-c6b9455c4528 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:10:11.505497 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-ce51715d-5ec3-4700-bfb7-6511eea43fdb tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (8951d6af-0c63-4ed3-b500-c6b9455c4528), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:11.505830 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-ce51715d-5ec3-4700-bfb7-6511eea43fdb tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Security group rule updated ['2a5bcd08-2f5c-4785-8968-f136b0051d59'] Sep 04 01:10:11.506270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-ce51715d-5ec3-4700-bfb7-6511eea43fdb tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Resource SecurityGroupRule deleted: edc26496-84fe-4696-9782-78e7aee897c2 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:10:11.506666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-ce51715d-5ec3-4700-bfb7-6511eea43fdb tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (edc26496-84fe-4696-9782-78e7aee897c2), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:11.506981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-ce51715d-5ec3-4700-bfb7-6511eea43fdb tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Security group rule updated ['2a5bcd08-2f5c-4785-8968-f136b0051d59'] Sep 04 01:10:11.508174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-ce51715d-5ec3-4700-bfb7-6511eea43fdb tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Resource SecurityGroupRule deleted: 62d9be9f-d0f8-4a14-9fce-32fa8406bf4f {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:10:11.508519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-ce51715d-5ec3-4700-bfb7-6511eea43fdb tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (62d9be9f-d0f8-4a14-9fce-32fa8406bf4f), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:11.508855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-ce51715d-5ec3-4700-bfb7-6511eea43fdb tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Security group rule updated ['2a5bcd08-2f5c-4785-8968-f136b0051d59'] Sep 04 01:10:11.509355 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-ce51715d-5ec3-4700-bfb7-6511eea43fdb tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Resource SecurityGroupRule deleted: cba7c2a1-55d9-479e-8432-5120b17f428d {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:10:11.509700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-ce51715d-5ec3-4700-bfb7-6511eea43fdb tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (cba7c2a1-55d9-479e-8432-5120b17f428d), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:11.510012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-ce51715d-5ec3-4700-bfb7-6511eea43fdb tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Security group rule updated ['2a5bcd08-2f5c-4785-8968-f136b0051d59'] Sep 04 01:10:11.913931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0a20e1d0-c52c-4c1e-ae42-f206b0ec6f96 tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Resource Port deleted: c7250ad8-1fdb-4a27-b9d9-e7622f80ae4b {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:10:11.914387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-0a20e1d0-c52c-4c1e-ae42-f206b0ec6f96 tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (c7250ad8-1fdb-4a27-b9d9-e7622f80ae4b), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:12.389543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:401 started Sep 04 01:10:12.391834 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5651,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=783000000,duration_sec=821,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:10:12.392563 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:10:12.392895 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:401 - starting polling. Elapsed:0.004 Sep 04 01:10:12.396072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:12.398642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port c7250ad8-1fdb-4a27-b9d9-e7622f80ae4b not present in bridge br-int Sep 04 01:10:12.398642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] net_uuid None not managed by VLAN manager Sep 04 01:10:12.398933 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for ['c7250ad8-1fdb-4a27-b9d9-e7622f80ae4b'] Sep 04 01:10:12.399256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port c7250ad8-1fdb-4a27-b9d9-e7622f80ae4b is not handled by the firewall. {{(pid=107812) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 04 01:10:12.403090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:401 - port information retrieved. Elapsed:0.014 Sep 04 01:10:12.403421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:401 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.014 Sep 04 01:10:12.448343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-d023bc5a-d0e4-41a1-8569-aa88b58446e0 tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:10:12Z,description='tempest-description--441263769',id=e95ae1f3-3d5c-45bf-84ed-24f618128ba8,is_default=False,name='tempest-securitygroup--449855155',project_id='e7dca68418a14d7da9aa63ac25f202e8',revision_number=1,rules=[SecurityGroupRule(1550e5b3-cf24-4688-99b3-d39d477a5be2),SecurityGroupRule(7f62b640-5da1-4930-b3e2-240f0b785879)],shared=False,stateful=True,updated_at=2022-09-04T01:10:12Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:10:12.448727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-d023bc5a-d0e4-41a1-8569-aa88b58446e0 tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (e95ae1f3-3d5c-45bf-84ed-24f618128ba8), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:12.449425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-d023bc5a-d0e4-41a1-8569-aa88b58446e0 tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:10:12Z,description=,direction='egress',ethertype='IPv4',id=1550e5b3-cf24-4688-99b3-d39d477a5be2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e7dca68418a14d7da9aa63ac25f202e8',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e95ae1f3-3d5c-45bf-84ed-24f618128ba8,updated_at=2022-09-04T01:10:12Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:10:12.449790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-d023bc5a-d0e4-41a1-8569-aa88b58446e0 tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (1550e5b3-cf24-4688-99b3-d39d477a5be2), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:12.450131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-d023bc5a-d0e4-41a1-8569-aa88b58446e0 tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Security group rule updated ['e95ae1f3-3d5c-45bf-84ed-24f618128ba8'] Sep 04 01:10:12.450854 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-d023bc5a-d0e4-41a1-8569-aa88b58446e0 tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:10:12Z,description=,direction='egress',ethertype='IPv6',id=7f62b640-5da1-4930-b3e2-240f0b785879,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e7dca68418a14d7da9aa63ac25f202e8',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e95ae1f3-3d5c-45bf-84ed-24f618128ba8,updated_at=2022-09-04T01:10:12Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:10:12.451214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-d023bc5a-d0e4-41a1-8569-aa88b58446e0 tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (7f62b640-5da1-4930-b3e2-240f0b785879), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:12.451547 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-d023bc5a-d0e4-41a1-8569-aa88b58446e0 tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Security group rule updated ['e95ae1f3-3d5c-45bf-84ed-24f618128ba8'] Sep 04 01:10:12.820406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-640d43b1-f8dc-4ffd-ada7-aa41f9bfa6c3 tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:10:12Z,description='',direction='ingress',ethertype='IPv4',id=33f7440f-60fc-4ed4-8dcc-486d5a3b1294,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='e7dca68418a14d7da9aa63ac25f202e8',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e95ae1f3-3d5c-45bf-84ed-24f618128ba8,updated_at=2022-09-04T01:10:12Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:10:12.821039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-640d43b1-f8dc-4ffd-ada7-aa41f9bfa6c3 tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (33f7440f-60fc-4ed4-8dcc-486d5a3b1294), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:12.821200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-640d43b1-f8dc-4ffd-ada7-aa41f9bfa6c3 tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Security group rule updated ['e95ae1f3-3d5c-45bf-84ed-24f618128ba8'] Sep 04 01:10:13.084812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-75c91425-0624-4d95-b198-b86a432981e0 tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:10:12Z,description='',direction='ingress',ethertype='IPv4',id=dbffe037-a73b-4d02-a984-c2f52b240ae1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e7dca68418a14d7da9aa63ac25f202e8',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e95ae1f3-3d5c-45bf-84ed-24f618128ba8,updated_at=2022-09-04T01:10:12Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:10:13.085233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-75c91425-0624-4d95-b198-b86a432981e0 tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (dbffe037-a73b-4d02-a984-c2f52b240ae1), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:13.085592 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-75c91425-0624-4d95-b198-b86a432981e0 tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Security group rule updated ['e95ae1f3-3d5c-45bf-84ed-24f618128ba8'] Sep 04 01:10:13.998315 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-92dc4bf7-e723-4690-b6e7-f731fdaf9d81 tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:10:13Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=7bd0ca2e-7896-4725-9c0d-a0da60cf0a30,mac_address=fa:16:3e:18:97:8d,name='',network_id=e8e0564a-d5c9-4fe0-b2d4-538f45096708,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(7bd0ca2e-7896-4725-9c0d-a0da60cf0a30),security_group_ids=set([]),status='N/A',updated_at=2022-09-04T01:10:13Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:10:13.999116 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-92dc4bf7-e723-4690-b6e7-f731fdaf9d81 tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (7bd0ca2e-7896-4725-9c0d-a0da60cf0a30), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:14.390433 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:402 started Sep 04 01:10:14.392965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5653,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=784000000,duration_sec=823,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:10:14.394275 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:10:14.394614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:402 - starting polling. Elapsed:0.004 Sep 04 01:10:14.397747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:14.403704 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:402 - port information retrieved. Elapsed:0.013 Sep 04 01:10:14.404071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:402 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.014 Sep 04 01:10:14.594247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-92dc4bf7-e723-4690-b6e7-f731fdaf9d81 tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Resource Port 7bd0ca2e-7896-4725-9c0d-a0da60cf0a30 updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': '1bd515ee-7416-4b1d-9d2b-c9244079bb36'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:10:14.597687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-92dc4bf7-e723-4690-b6e7-f731fdaf9d81 tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (7bd0ca2e-7896-4725-9c0d-a0da60cf0a30), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:15.173697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Resource Port 19f203f1-14db-4bb0-aaad-c8e57c75d249 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:10:15.174329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (19f203f1-14db-4bb0-aaad-c8e57c75d249), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:16.391231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:403 started Sep 04 01:10:16.393865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5655,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=785000000,duration_sec=825,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:10:16.394464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:10:16.394903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:403 - starting polling. Elapsed:0.004 Sep 04 01:10:16.399513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:16.403807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:403 - port information retrieved. Elapsed:0.013 Sep 04 01:10:16.404172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:403 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Sep 04 01:10:17.250560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Resource Port 19f203f1-14db-4bb0-aaad-c8e57c75d249 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:10:17.251040 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (19f203f1-14db-4bb0-aaad-c8e57c75d249), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:18.392148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:404 started Sep 04 01:10:18.394719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5657,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=786000000,duration_sec=827,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:10:18.395354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:10:18.395752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:404 - starting polling. Elapsed:0.004 Sep 04 01:10:18.399151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:18.403191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:404 - port information retrieved. Elapsed:0.011 Sep 04 01:10:18.403604 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:404 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Sep 04 01:10:19.331814 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-589d2f6d-f12e-487f-ba2c-1be4ce2d2a71 tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:10:18Z,data_plane_status=None,description='',device_id='52505c46-cb03-49ec-a7ba-696d7c6ac219',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=73f5bdf6-a4ae-435e-9050-14b4d54218f9,mac_address=fa:16:3e:9d:8f:72,name='',network_id=1fb5aed8-696d-4f87-8b2a-7d29744538a8,numa_affinity_policy=,project_id='e7dca68418a14d7da9aa63ac25f202e8',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(73f5bdf6-a4ae-435e-9050-14b4d54218f9),security_group_ids=set([e95ae1f3-3d5c-45bf-84ed-24f618128ba8]),status='DOWN',updated_at=2022-09-04T01:10:18Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:10:19.332193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-589d2f6d-f12e-487f-ba2c-1be4ce2d2a71 tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (73f5bdf6-a4ae-435e-9050-14b4d54218f9), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:19.332716 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-589d2f6d-f12e-487f-ba2c-1be4ce2d2a71 tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Security group member updated {'e95ae1f3-3d5c-45bf-84ed-24f618128ba8'} Sep 04 01:10:20.103903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-08322714-b63e-4306-9c0f-01170ca16d37 service neutron] Resource Port 73f5bdf6-a4ae-435e-9050-14b4d54218f9 updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=73f5bdf6-a4ae-435e-9050-14b4d54218f9,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=73f5bdf6-a4ae-435e-9050-14b4d54218f9,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:10:20.105004 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-08322714-b63e-4306-9c0f-01170ca16d37 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (73f5bdf6-a4ae-435e-9050-14b4d54218f9), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:20.348711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-08322714-b63e-4306-9c0f-01170ca16d37 service neutron] Resource Port 73f5bdf6-a4ae-435e-9050-14b4d54218f9 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=73f5bdf6-a4ae-435e-9050-14b4d54218f9,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=73f5bdf6-a4ae-435e-9050-14b4d54218f9,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=73f5bdf6-a4ae-435e-9050-14b4d54218f9,segment=NetworkSegment(79b84dcb-99f6-4af2-ac73-30fcaae597f6),segment_id=79b84dcb-99f6-4af2-ac73-30fcaae597f6)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:10:20.349233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-08322714-b63e-4306-9c0f-01170ca16d37 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (73f5bdf6-a4ae-435e-9050-14b4d54218f9), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:20.393009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:405 started Sep 04 01:10:20.395590 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5659,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=787000000,duration_sec=829,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:10:20.396156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:10:20.396489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:405 - starting polling. Elapsed:0.004 Sep 04 01:10:20.399466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:20.403385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:405 - port information retrieved. Elapsed:0.011 Sep 04 01:10:20.403716 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:405 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 04 01:10:22.394318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:406 started Sep 04 01:10:22.396757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade565b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=788000000,duration_sec=831,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:10:22.397474 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:10:22.397825 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:406 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:10:24.395376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:407 started Sep 04 01:10:24.397774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade565d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=789000000,duration_sec=833,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:10:24.398326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:10:24.398699 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:407 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:10:25.193428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Resource Port 73f5bdf6-a4ae-435e-9050-14b4d54218f9 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:10:25.193812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (73f5bdf6-a4ae-435e-9050-14b4d54218f9), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:26.396024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:408 started Sep 04 01:10:26.398433 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade565f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=790000000,duration_sec=835,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:10:26.399000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:10:26.399337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:408 - starting polling. Elapsed:0.003 Sep 04 01:10:26.402333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:26.406254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:408 - port information retrieved. Elapsed:0.010 Sep 04 01:10:26.406592 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:408 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 04 01:10:27.291393 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Resource Port 73f5bdf6-a4ae-435e-9050-14b4d54218f9 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:10:27.291766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (73f5bdf6-a4ae-435e-9050-14b4d54218f9), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:28.397294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:409 started Sep 04 01:10:28.399868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5661,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=791000000,duration_sec=837,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:10:28.400509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:10:28.400912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:409 - starting polling. Elapsed:0.004 Sep 04 01:10:28.403788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:28.407769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:409 - port information retrieved. Elapsed:0.011 Sep 04 01:10:28.408172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:409 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 04 01:10:30.289713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-8694f30c-98dc-4c71-ba55-588ab570ecad tempest-ServerRescueNegativeTestJSON-1367456352 tempest-ServerRescueNegativeTestJSON-1367456352-project] Resource Port deleted: 62f5079a-1d7d-4c5c-bdcd-0af337b6235b {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:10:30.290941 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-8694f30c-98dc-4c71-ba55-588ab570ecad tempest-ServerRescueNegativeTestJSON-1367456352 tempest-ServerRescueNegativeTestJSON-1367456352-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (62f5079a-1d7d-4c5c-bdcd-0af337b6235b), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:30.291492 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-8694f30c-98dc-4c71-ba55-588ab570ecad tempest-ServerRescueNegativeTestJSON-1367456352 tempest-ServerRescueNegativeTestJSON-1367456352-project] Security group member updated {'408a6cc9-789d-4d36-bc4c-5052f5aa27fe'} Sep 04 01:10:30.398179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:410 started Sep 04 01:10:30.402011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5663,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=792000000,duration_sec=839,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:10:30.402806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:10:30.403173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:410 - starting polling. Elapsed:0.005 Sep 04 01:10:30.406047 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:30.408070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 62f5079a-1d7d-4c5c-bdcd-0af337b6235b not present in bridge br-int Sep 04 01:10:30.408412 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] net_uuid None not managed by VLAN manager Sep 04 01:10:30.408699 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for ['62f5079a-1d7d-4c5c-bdcd-0af337b6235b'] Sep 04 01:10:30.409030 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 62f5079a-1d7d-4c5c-bdcd-0af337b6235b is not handled by the firewall. {{(pid=107812) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 04 01:10:30.412935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:410 - port information retrieved. Elapsed:0.015 Sep 04 01:10:30.413298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:410 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.015 Sep 04 01:10:32.399198 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:411 started Sep 04 01:10:32.402651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5665,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=794000000,duration_sec=841,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:10:32.403218 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:10:32.403568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:411 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 04 01:10:34.186527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-21e2dd8e-1710-465e-b23b-e058ea689322 tempest-ServerRescueNegativeTestJSON-1367456352 tempest-ServerRescueNegativeTestJSON-1367456352-project] Resource SecurityGroup deleted: 408a6cc9-789d-4d36-bc4c-5052f5aa27fe {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:10:34.187618 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-21e2dd8e-1710-465e-b23b-e058ea689322 tempest-ServerRescueNegativeTestJSON-1367456352 tempest-ServerRescueNegativeTestJSON-1367456352-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (408a6cc9-789d-4d36-bc4c-5052f5aa27fe), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:34.188299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21e2dd8e-1710-465e-b23b-e058ea689322 tempest-ServerRescueNegativeTestJSON-1367456352 tempest-ServerRescueNegativeTestJSON-1367456352-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('408a6cc9-789d-4d36-bc4c-5052f5aa27fe',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:10:34.203212 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-21e2dd8e-1710-465e-b23b-e058ea689322 tempest-ServerRescueNegativeTestJSON-1367456352 tempest-ServerRescueNegativeTestJSON-1367456352-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('408a6cc9-789d-4d36-bc4c-5052f5aa27fe',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:10:34.213585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-21e2dd8e-1710-465e-b23b-e058ea689322 tempest-ServerRescueNegativeTestJSON-1367456352 tempest-ServerRescueNegativeTestJSON-1367456352-project] Resource SecurityGroupRule deleted: 40dc393e-5720-4d65-b13b-03dd5a9dbb29 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:10:34.213585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-21e2dd8e-1710-465e-b23b-e058ea689322 tempest-ServerRescueNegativeTestJSON-1367456352 tempest-ServerRescueNegativeTestJSON-1367456352-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (40dc393e-5720-4d65-b13b-03dd5a9dbb29), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:34.213585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-21e2dd8e-1710-465e-b23b-e058ea689322 tempest-ServerRescueNegativeTestJSON-1367456352 tempest-ServerRescueNegativeTestJSON-1367456352-project] Security group rule updated ['408a6cc9-789d-4d36-bc4c-5052f5aa27fe'] Sep 04 01:10:34.213585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-21e2dd8e-1710-465e-b23b-e058ea689322 tempest-ServerRescueNegativeTestJSON-1367456352 tempest-ServerRescueNegativeTestJSON-1367456352-project] Resource SecurityGroupRule deleted: aa56283d-3d01-4d74-b695-8bba9f8043d4 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:10:34.214522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-21e2dd8e-1710-465e-b23b-e058ea689322 tempest-ServerRescueNegativeTestJSON-1367456352 tempest-ServerRescueNegativeTestJSON-1367456352-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (aa56283d-3d01-4d74-b695-8bba9f8043d4), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:34.214522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-21e2dd8e-1710-465e-b23b-e058ea689322 tempest-ServerRescueNegativeTestJSON-1367456352 tempest-ServerRescueNegativeTestJSON-1367456352-project] Security group rule updated ['408a6cc9-789d-4d36-bc4c-5052f5aa27fe'] Sep 04 01:10:34.214522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-21e2dd8e-1710-465e-b23b-e058ea689322 tempest-ServerRescueNegativeTestJSON-1367456352 tempest-ServerRescueNegativeTestJSON-1367456352-project] Resource SecurityGroupRule deleted: 18c583c9-f7ad-49a0-a17e-8451d28c139a {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:10:34.214522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-21e2dd8e-1710-465e-b23b-e058ea689322 tempest-ServerRescueNegativeTestJSON-1367456352 tempest-ServerRescueNegativeTestJSON-1367456352-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (18c583c9-f7ad-49a0-a17e-8451d28c139a), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:34.214880 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-21e2dd8e-1710-465e-b23b-e058ea689322 tempest-ServerRescueNegativeTestJSON-1367456352 tempest-ServerRescueNegativeTestJSON-1367456352-project] Security group rule updated ['408a6cc9-789d-4d36-bc4c-5052f5aa27fe'] Sep 04 01:10:34.214880 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-21e2dd8e-1710-465e-b23b-e058ea689322 tempest-ServerRescueNegativeTestJSON-1367456352 tempest-ServerRescueNegativeTestJSON-1367456352-project] Resource SecurityGroupRule deleted: 647b96b9-953e-4175-a178-3f0e22532333 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:10:34.214880 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-21e2dd8e-1710-465e-b23b-e058ea689322 tempest-ServerRescueNegativeTestJSON-1367456352 tempest-ServerRescueNegativeTestJSON-1367456352-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (647b96b9-953e-4175-a178-3f0e22532333), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:34.214880 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-21e2dd8e-1710-465e-b23b-e058ea689322 tempest-ServerRescueNegativeTestJSON-1367456352 tempest-ServerRescueNegativeTestJSON-1367456352-project] Security group rule updated ['408a6cc9-789d-4d36-bc4c-5052f5aa27fe'] Sep 04 01:10:34.400236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:412 started Sep 04 01:10:34.402987 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5667,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=794000000,duration_sec=843,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:10:34.403505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:10:34.403863 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:412 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:10:34.647065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4b1f688a-4835-48d6-a855-9f2c0ed2f773 tempest-ServerRescueNegativeTestJSON-1367456352 tempest-ServerRescueNegativeTestJSON-1367456352-project] Resource Port deleted: 6c428213-1413-4eee-be61-4999c8f0b190 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:10:34.652546 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4b1f688a-4835-48d6-a855-9f2c0ed2f773 tempest-ServerRescueNegativeTestJSON-1367456352 tempest-ServerRescueNegativeTestJSON-1367456352-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (6c428213-1413-4eee-be61-4999c8f0b190), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:36.400912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:413 started Sep 04 01:10:36.403675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5669,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=795000000,duration_sec=845,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:10:36.404241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:10:36.404572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:413 - starting polling. Elapsed:0.004 Sep 04 01:10:36.407451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:36.409393 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 6c428213-1413-4eee-be61-4999c8f0b190 not present in bridge br-int Sep 04 01:10:36.409722 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] net_uuid None not managed by VLAN manager Sep 04 01:10:36.410005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for ['6c428213-1413-4eee-be61-4999c8f0b190'] Sep 04 01:10:36.410321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 6c428213-1413-4eee-be61-4999c8f0b190 is not handled by the firewall. {{(pid=107812) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 04 01:10:36.414176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:413 - port information retrieved. Elapsed:0.013 Sep 04 01:10:36.414502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:413 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.014 Sep 04 01:10:38.402191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:414 started Sep 04 01:10:38.404565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade566b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=796000000,duration_sec=847,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:10:38.405151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:10:38.405501 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:414 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:10:40.402974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:415 started Sep 04 01:10:40.405534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade566d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=797000000,duration_sec=849,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:10:40.406192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:10:40.406793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:415 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:10:40.715133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-3735ac6e-2ee3-4d92-853c-85238d6a6776 tempest-ServerRescueNegativeTestJSON-1367456352 tempest-ServerRescueNegativeTestJSON-1367456352-project] Resource Port deleted: addc777a-4bdc-4153-92fa-8184c15d2cd1 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:10:40.715585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-3735ac6e-2ee3-4d92-853c-85238d6a6776 tempest-ServerRescueNegativeTestJSON-1367456352 tempest-ServerRescueNegativeTestJSON-1367456352-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (addc777a-4bdc-4153-92fa-8184c15d2cd1), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:40.716240 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-3735ac6e-2ee3-4d92-853c-85238d6a6776 tempest-ServerRescueNegativeTestJSON-1367456352 tempest-ServerRescueNegativeTestJSON-1367456352-project] Security group member updated {'258c239a-16c7-45ea-bf27-4f76d118a726'} Sep 04 01:10:42.404217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:416 started Sep 04 01:10:42.411195 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade566f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=798000000,duration_sec=851,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:10:42.411843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:10:42.412174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:416 - starting polling. Elapsed:0.008 Sep 04 01:10:42.414970 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:42.416918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port addc777a-4bdc-4153-92fa-8184c15d2cd1 not present in bridge br-int Sep 04 01:10:42.417782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] net_uuid None not managed by VLAN manager Sep 04 01:10:42.420083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for ['addc777a-4bdc-4153-92fa-8184c15d2cd1'] Sep 04 01:10:42.420083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port addc777a-4bdc-4153-92fa-8184c15d2cd1 is not handled by the firewall. {{(pid=107812) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 04 01:10:42.422286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:416 - port information retrieved. Elapsed:0.018 Sep 04 01:10:42.422612 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:416 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.019 Sep 04 01:10:44.404997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:417 started Sep 04 01:10:44.407405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5671,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=799000000,duration_sec=853,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:10:44.408168 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:10:44.408515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:417 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:10:46.406456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:418 started Sep 04 01:10:46.408900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5673,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=800000000,duration_sec=855,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:10:46.409527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:10:46.409880 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:418 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:10:46.775522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-fffb9bd4-455d-4eb3-8301-3c2bb980b77d tempest-ServerRescueNegativeTestJSON-1367456352 tempest-ServerRescueNegativeTestJSON-1367456352-project] Resource Port deleted: 28efc83e-9838-45a7-9fd3-3625eeff4b09 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:10:46.776262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-fffb9bd4-455d-4eb3-8301-3c2bb980b77d tempest-ServerRescueNegativeTestJSON-1367456352 tempest-ServerRescueNegativeTestJSON-1367456352-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (28efc83e-9838-45a7-9fd3-3625eeff4b09), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:46.777208 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-fffb9bd4-455d-4eb3-8301-3c2bb980b77d tempest-ServerRescueNegativeTestJSON-1367456352 tempest-ServerRescueNegativeTestJSON-1367456352-project] Security group member updated {'258c239a-16c7-45ea-bf27-4f76d118a726'} Sep 04 01:10:48.407352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:419 started Sep 04 01:10:48.416375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5675,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=802000000,duration_sec=857,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:10:48.416375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:10:48.416375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:419 - starting polling. Elapsed:0.005 Sep 04 01:10:48.420628 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:48.420628 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 28efc83e-9838-45a7-9fd3-3625eeff4b09 not present in bridge br-int Sep 04 01:10:48.421000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] net_uuid None not managed by VLAN manager Sep 04 01:10:48.421000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for ['28efc83e-9838-45a7-9fd3-3625eeff4b09'] Sep 04 01:10:48.421310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 28efc83e-9838-45a7-9fd3-3625eeff4b09 is not handled by the firewall. {{(pid=107812) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 04 01:10:48.426063 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:419 - port information retrieved. Elapsed:0.019 Sep 04 01:10:48.426399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:419 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.019 Sep 04 01:10:49.513467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-42bb55f6-c4fc-45dc-895f-c4edea0846e6 admin admin] Resource Port deleted: f38c3884-111a-49d9-bcf1-6a965ff5e110 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:10:49.514069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-42bb55f6-c4fc-45dc-895f-c4edea0846e6 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (f38c3884-111a-49d9-bcf1-6a965ff5e110), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:50.408612 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:420 started Sep 04 01:10:50.411342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5677,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=803000000,duration_sec=859,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:10:50.412096 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:10:50.412621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:420 - starting polling. Elapsed:0.004 Sep 04 01:10:50.415662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:50.420417 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-f38c3884-11, col_values=(('tag', 4095),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:10:50.434750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade5679,OFPFlowMod(buffer_id=4294967295,command=0,cookie=6887031442322345889,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 16}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:10:50.437235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for ['f38c3884-111a-49d9-bcf1-6a965ff5e110'] Sep 04 01:10:50.438001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 4 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:10:50.481131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[b288ac5f-4497-4228-854b-6d9469f417d7]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:10:50.485650 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:420 - port information retrieved. Elapsed:0.077 Sep 04 01:10:50.485996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:420 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.078 Sep 04 01:10:50.866868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["0dce06b8-3668-4e59-a593-1c7220ba03f7","delete","qr-f38c3884-11",16,["map",[["attached-mac","fa:16:3e:62:0b:90"],["iface-id","f38c3884-111a-49d9-bcf1-6a965ff5e110"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:10:50.936612 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-40b81079-3acf-47c8-8209-d7e416efcd88 admin admin] Resource Port deleted: 6771cbc4-3e4b-419f-b87f-2db662f6e010 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:10:50.936992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-40b81079-3acf-47c8-8209-d7e416efcd88 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (6771cbc4-3e4b-419f-b87f-2db662f6e010), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:51.270627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["31683484-7b44-44e5-80e9-fdec0a727376","delete","qg-6771cbc4-3e",17,["map",[["attached-mac","fa:16:3e:50:c6:c9"],["iface-id","6771cbc4-3e4b-419f-b87f-2db662f6e010"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:10:51.614810 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b48466a7-b4b2-44cb-9a0b-b5471cad8727 admin admin] Resource Subnet deleted: 35ea244b-d6a3-4c9a-a9b3-3f9d2814dee0 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:10:51.615187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b48466a7-b4b2-44cb-9a0b-b5471cad8727 admin admin] Publish callbacks [] for Subnet (35ea244b-d6a3-4c9a-a9b3-3f9d2814dee0), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:51.758353 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["295bb9a1-b5f4-42bc-9182-173c2ecd96db","delete","tapf45b435f-0f",10,["map",[["attached-mac","fa:16:3e:eb:c4:7f"],["iface-id","f45b435f-0f64-41fe-a6ec-36683da765f9"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:10:52.041286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-ff0ce576-a0f8-4179-a6fe-4639fcdd4a4f admin admin] Resource Port deleted: f45b435f-0f64-41fe-a6ec-36683da765f9 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:10:52.043195 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-ff0ce576-a0f8-4179-a6fe-4639fcdd4a4f admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (f45b435f-0f64-41fe-a6ec-36683da765f9), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:52.058891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-dd73f9f9-dc5f-4091-8e99-d0efe0557cd4 None None] Resource Port deleted: f45b435f-0f64-41fe-a6ec-36683da765f9 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:10:52.059998 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-dd73f9f9-dc5f-4091-8e99-d0efe0557cd4 None None] Skipped duplicate delete event for f45b435f-0f64-41fe-a6ec-36683da765f9 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:209}} Sep 04 01:10:52.325632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-ff0ce576-a0f8-4179-a6fe-4639fcdd4a4f admin admin] Resource Network deleted: b16f22e1-6fb1-440b-98eb-845123e960e6 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:10:52.325858 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-ff0ce576-a0f8-4179-a6fe-4639fcdd4a4f admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533'] for Network (b16f22e1-6fb1-440b-98eb-845123e960e6), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:52.409886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:421 started Sep 04 01:10:52.412208 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade567b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=804000000,duration_sec=861,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:10:52.412822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:10:52.413350 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:421 - starting polling. Elapsed:0.004 Sep 04 01:10:52.415938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:52.421586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade567d,OFPFlowMod(buffer_id=4294967295,command=3,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 16}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:10:52.423409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade567f,OFPFlowMod(buffer_id=4294967295,command=3,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 17}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:10:52.425214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade5681,OFPFlowMod(buffer_id=4294967295,command=3,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 10}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:10:52.425532 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:421 - port information retrieved. Elapsed:0.016 Sep 04 01:10:52.425868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Starting to process devices in:{'current': {'c2f724af-5dbd-4d91-83cd-c5152b744599', 'da545e71-9e15-495e-b08a-2c36ede84742', 'a6788698-0516-4d8a-8fe8-2add6e7f6e94', '9db3ca9e-27d3-4852-b8c6-3fc745d2d055', '3fa24970-97a7-4f46-ac55-0b24323fa402', '0a1a9f7e-73de-4620-ae03-4b1d50d7f706', '3045b911-01c5-4fc3-8e89-ac2d9cea12a8', '89aa06b4-bbf1-40c2-bb48-500c3aecdf48', '68e4df44-e581-4fa1-922b-1b78021d5d7b', 'e507db86-47c3-4953-96bb-c5e552b4f602', '4ed942cd-0f45-4d77-a66d-1d6c875877dc', '53e7a39c-e9ce-45c4-84af-632f2aac70ae', '378bbdd4-3077-4657-8055-fdc0a7600948', '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', 'dd44c60a-dd0f-4ff2-85ae-8c012af89cf9', 'b4f93563-ff7a-44c4-96a1-87f6e4348648', 'f0af75e4-63aa-44d3-bff7-973c3caf9bf9', '1cf499fb-10a0-4af2-afec-5f610dc85da6', 'ca102ce7-433c-4029-aabf-33d944165ff1'}, 'added': set(), 'removed': {'6771cbc4-3e4b-419f-b87f-2db662f6e010', 'f38c3884-111a-49d9-bcf1-6a965ff5e110', 'f45b435f-0f64-41fe-a6ec-36683da765f9'}, 'updated': set(), 're_added': set()} {{(pid=107812) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 04 01:10:52.426196 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:421 - agent port security group processed in 0.000 Sep 04 01:10:52.428575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Configuration for devices up [] and devices down [] completed. Sep 04 01:10:52.428759 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for {'6771cbc4-3e4b-419f-b87f-2db662f6e010', 'f38c3884-111a-49d9-bcf1-6a965ff5e110', 'f45b435f-0f64-41fe-a6ec-36683da765f9'} Sep 04 01:10:52.429169 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port f38c3884-111a-49d9-bcf1-6a965ff5e110 is not handled by the firewall. {{(pid=107812) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 04 01:10:52.433582 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 8 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:10:52.466856 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[781ca99b-1806-474a-8ff9-075acb61db1c]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:10:52.467426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Ports {'6771cbc4-3e4b-419f-b87f-2db662f6e010', 'f38c3884-111a-49d9-bcf1-6a965ff5e110', 'f45b435f-0f64-41fe-a6ec-36683da765f9'} removed Sep 04 01:10:52.535900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port removal failed for set() {{(pid=107812) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 04 01:10:52.536352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] net_uuid None not managed by VLAN manager Sep 04 01:10:52.536717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Reclaiming vlan = 7 from net-id = b16f22e1-6fb1-440b-98eb-845123e960e6, seg-id = 174 Sep 04 01:10:52.539642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x1fd38c03,OFPFlowMod(buffer_id=4294967295,command=3,cookie=6561907047025962751,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4103}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:10:52.542774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xeade5683,OFPFlowMod(buffer_id=4294967295,command=3,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4270}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:10:52.543095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:421 - treat_devices_removed completed in 0.114 Sep 04 01:10:52.543387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:421 - ports processed. Elapsed:0.134 Sep 04 01:10:52.543781 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:421 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 3}}. Elapsed:0.134 Sep 04 01:10:52.938843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-ffad01c4-fde0-4d55-96cb-b276665b1cb4 admin admin] Resource SecurityGroup deleted: 258c239a-16c7-45ea-bf27-4f76d118a726 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:10:52.939282 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-ffad01c4-fde0-4d55-96cb-b276665b1cb4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (258c239a-16c7-45ea-bf27-4f76d118a726), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:52.939933 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffad01c4-fde0-4d55-96cb-b276665b1cb4 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('258c239a-16c7-45ea-bf27-4f76d118a726',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:10:52.954108 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-ffad01c4-fde0-4d55-96cb-b276665b1cb4 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('258c239a-16c7-45ea-bf27-4f76d118a726',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:10:52.954614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-ffad01c4-fde0-4d55-96cb-b276665b1cb4 admin admin] Resource SecurityGroupRule deleted: 21815125-ca4b-4da3-9ec7-532ddbd87938 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:10:52.954985 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-ffad01c4-fde0-4d55-96cb-b276665b1cb4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (21815125-ca4b-4da3-9ec7-532ddbd87938), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:52.955319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-ffad01c4-fde0-4d55-96cb-b276665b1cb4 admin admin] Security group rule updated ['258c239a-16c7-45ea-bf27-4f76d118a726'] Sep 04 01:10:52.955788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-ffad01c4-fde0-4d55-96cb-b276665b1cb4 admin admin] Resource SecurityGroupRule deleted: 43ae738d-3093-40be-9760-0cd0522375c6 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:10:52.956136 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-ffad01c4-fde0-4d55-96cb-b276665b1cb4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (43ae738d-3093-40be-9760-0cd0522375c6), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:52.956454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-ffad01c4-fde0-4d55-96cb-b276665b1cb4 admin admin] Security group rule updated ['258c239a-16c7-45ea-bf27-4f76d118a726'] Sep 04 01:10:52.956872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-ffad01c4-fde0-4d55-96cb-b276665b1cb4 admin admin] Resource SecurityGroupRule deleted: c491b2d5-dc59-43ba-9b19-60d3cf620719 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:10:52.957251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-ffad01c4-fde0-4d55-96cb-b276665b1cb4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (c491b2d5-dc59-43ba-9b19-60d3cf620719), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:52.957572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-ffad01c4-fde0-4d55-96cb-b276665b1cb4 admin admin] Security group rule updated ['258c239a-16c7-45ea-bf27-4f76d118a726'] Sep 04 01:10:52.957986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-ffad01c4-fde0-4d55-96cb-b276665b1cb4 admin admin] Resource SecurityGroupRule deleted: efd900ab-5216-449c-865c-0b8e1f25b0be {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:10:52.958329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-ffad01c4-fde0-4d55-96cb-b276665b1cb4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (efd900ab-5216-449c-865c-0b8e1f25b0be), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:10:52.958974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-ffad01c4-fde0-4d55-96cb-b276665b1cb4 admin admin] Security group rule updated ['258c239a-16c7-45ea-bf27-4f76d118a726'] Sep 04 01:10:54.410422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:422 started Sep 04 01:10:54.412938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5685,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=804000000,duration_sec=863,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:10:54.413564 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:10:54.413922 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:422 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:10:56.411760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:423 started Sep 04 01:10:56.414233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5687,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=806000000,duration_sec=865,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:10:56.414789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:10:56.415135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:423 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:10:58.412487 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:424 started Sep 04 01:10:58.415861 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5689,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=807000000,duration_sec=867,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:10:58.416020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:10:58.416341 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:424 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:11:00.412856 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:425 started Sep 04 01:11:00.415460 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade568b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=807000000,duration_sec=869,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:11:00.416017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:11:00.416366 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:425 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:11:02.414253 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:426 started Sep 04 01:11:02.416630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade568d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=808000000,duration_sec=871,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:11:02.417230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:11:02.417573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:426 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:11:04.415046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:427 started Sep 04 01:11:04.417406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade568f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=809000000,duration_sec=873,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:11:04.417997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:11:04.418382 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:427 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:11:05.832118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b6788a4c-68f5-484b-baa4-0bed583c69b6 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Resource Port deleted: 2aad8c1f-5af7-4478-b2c4-782e5042cc6b {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:11:05.832118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b6788a4c-68f5-484b-baa4-0bed583c69b6 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (2aad8c1f-5af7-4478-b2c4-782e5042cc6b), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:05.832118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-b6788a4c-68f5-484b-baa4-0bed583c69b6 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Security group member updated {'3188d55b-e58c-4649-bc32-63a6cf0b7421'} Sep 04 01:11:06.416382 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:428 started Sep 04 01:11:06.418759 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5691,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=810000000,duration_sec=875,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:11:06.419533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:11:06.419889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:428 - starting polling. Elapsed:0.004 Sep 04 01:11:06.423768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:06.424799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 2aad8c1f-5af7-4478-b2c4-782e5042cc6b not present in bridge br-int Sep 04 01:11:06.425159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] net_uuid None not managed by VLAN manager Sep 04 01:11:06.425609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for ['2aad8c1f-5af7-4478-b2c4-782e5042cc6b'] Sep 04 01:11:06.425944 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 2aad8c1f-5af7-4478-b2c4-782e5042cc6b is not handled by the firewall. {{(pid=107812) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 04 01:11:06.429550 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:428 - port information retrieved. Elapsed:0.013 Sep 04 01:11:06.429847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:428 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.014 Sep 04 01:11:07.740709 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-53cccb2b-364f-42e7-b154-b3cc60e6a6e9 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:11:07Z,description='Default security group',id=641140a8-9603-4e56-a31e-b3fa1ed9f331,is_default=True,name='default',project_id='d04a2e7c3c4743dc8ef7d9a3b0fc922b',revision_number=1,rules=[SecurityGroupRule(1077d6ca-bac2-4846-814b-ae8b25131d64),SecurityGroupRule(a94caa58-8969-48f6-b147-6d43eb00bf73),SecurityGroupRule(da01ae00-e6f5-4464-8550-15c4d1eaff18),SecurityGroupRule(f77d817d-73f8-4f08-914e-165ded3489c2)],shared=False,stateful=True,updated_at=2022-09-04T01:11:07Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:11:07.741343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-53cccb2b-364f-42e7-b154-b3cc60e6a6e9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (641140a8-9603-4e56-a31e-b3fa1ed9f331), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:07.741756 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-53cccb2b-364f-42e7-b154-b3cc60e6a6e9 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:11:07Z,description=,direction='egress',ethertype='IPv4',id=1077d6ca-bac2-4846-814b-ae8b25131d64,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d04a2e7c3c4743dc8ef7d9a3b0fc922b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=641140a8-9603-4e56-a31e-b3fa1ed9f331,updated_at=2022-09-04T01:11:07Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:11:07.742117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-53cccb2b-364f-42e7-b154-b3cc60e6a6e9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (1077d6ca-bac2-4846-814b-ae8b25131d64), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:07.742455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-53cccb2b-364f-42e7-b154-b3cc60e6a6e9 admin admin] Security group rule updated ['641140a8-9603-4e56-a31e-b3fa1ed9f331'] Sep 04 01:11:07.743175 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-53cccb2b-364f-42e7-b154-b3cc60e6a6e9 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:11:07Z,description=,direction='ingress',ethertype='IPv4',id=a94caa58-8969-48f6-b147-6d43eb00bf73,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d04a2e7c3c4743dc8ef7d9a3b0fc922b',protocol=,remote_address_group_id=,remote_group_id=641140a8-9603-4e56-a31e-b3fa1ed9f331,remote_ip_prefix=,revision_number=0,security_group_id=641140a8-9603-4e56-a31e-b3fa1ed9f331,updated_at=2022-09-04T01:11:07Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:11:07.743623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-53cccb2b-364f-42e7-b154-b3cc60e6a6e9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (a94caa58-8969-48f6-b147-6d43eb00bf73), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:07.743895 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-53cccb2b-364f-42e7-b154-b3cc60e6a6e9 admin admin] Security group rule updated ['641140a8-9603-4e56-a31e-b3fa1ed9f331'] Sep 04 01:11:07.744589 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-53cccb2b-364f-42e7-b154-b3cc60e6a6e9 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:11:07Z,description=,direction='egress',ethertype='IPv6',id=da01ae00-e6f5-4464-8550-15c4d1eaff18,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d04a2e7c3c4743dc8ef7d9a3b0fc922b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=641140a8-9603-4e56-a31e-b3fa1ed9f331,updated_at=2022-09-04T01:11:07Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:11:07.744940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-53cccb2b-364f-42e7-b154-b3cc60e6a6e9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (da01ae00-e6f5-4464-8550-15c4d1eaff18), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:07.745296 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-53cccb2b-364f-42e7-b154-b3cc60e6a6e9 admin admin] Security group rule updated ['641140a8-9603-4e56-a31e-b3fa1ed9f331'] Sep 04 01:11:07.745999 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-53cccb2b-364f-42e7-b154-b3cc60e6a6e9 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:11:07Z,description=,direction='ingress',ethertype='IPv6',id=f77d817d-73f8-4f08-914e-165ded3489c2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d04a2e7c3c4743dc8ef7d9a3b0fc922b',protocol=,remote_address_group_id=,remote_group_id=641140a8-9603-4e56-a31e-b3fa1ed9f331,remote_ip_prefix=,revision_number=0,security_group_id=641140a8-9603-4e56-a31e-b3fa1ed9f331,updated_at=2022-09-04T01:11:07Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:11:07.746351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-53cccb2b-364f-42e7-b154-b3cc60e6a6e9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (f77d817d-73f8-4f08-914e-165ded3489c2), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:07.746676 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-53cccb2b-364f-42e7-b154-b3cc60e6a6e9 admin admin] Security group rule updated ['641140a8-9603-4e56-a31e-b3fa1ed9f331'] Sep 04 01:11:07.944388 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-45c336a4-cf8b-4055-96b8-d58660e2b28d admin admin] Resource SecurityGroup deleted: 641140a8-9603-4e56-a31e-b3fa1ed9f331 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:11:07.944900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-45c336a4-cf8b-4055-96b8-d58660e2b28d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (641140a8-9603-4e56-a31e-b3fa1ed9f331), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:07.945289 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45c336a4-cf8b-4055-96b8-d58660e2b28d admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('641140a8-9603-4e56-a31e-b3fa1ed9f331',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:11:07.959772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-45c336a4-cf8b-4055-96b8-d58660e2b28d admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('641140a8-9603-4e56-a31e-b3fa1ed9f331',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:11:07.960272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-45c336a4-cf8b-4055-96b8-d58660e2b28d admin admin] Resource SecurityGroupRule deleted: 1077d6ca-bac2-4846-814b-ae8b25131d64 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:11:07.960646 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-45c336a4-cf8b-4055-96b8-d58660e2b28d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (1077d6ca-bac2-4846-814b-ae8b25131d64), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:07.961035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-45c336a4-cf8b-4055-96b8-d58660e2b28d admin admin] Security group rule updated ['641140a8-9603-4e56-a31e-b3fa1ed9f331'] Sep 04 01:11:07.961906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-45c336a4-cf8b-4055-96b8-d58660e2b28d admin admin] Resource SecurityGroupRule deleted: a94caa58-8969-48f6-b147-6d43eb00bf73 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:11:07.962285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-45c336a4-cf8b-4055-96b8-d58660e2b28d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (a94caa58-8969-48f6-b147-6d43eb00bf73), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:07.962631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-45c336a4-cf8b-4055-96b8-d58660e2b28d admin admin] Security group rule updated ['641140a8-9603-4e56-a31e-b3fa1ed9f331'] Sep 04 01:11:07.963055 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-45c336a4-cf8b-4055-96b8-d58660e2b28d admin admin] Resource SecurityGroupRule deleted: da01ae00-e6f5-4464-8550-15c4d1eaff18 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:11:07.963420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-45c336a4-cf8b-4055-96b8-d58660e2b28d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (da01ae00-e6f5-4464-8550-15c4d1eaff18), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:07.963746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-45c336a4-cf8b-4055-96b8-d58660e2b28d admin admin] Security group rule updated ['641140a8-9603-4e56-a31e-b3fa1ed9f331'] Sep 04 01:11:07.964157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-45c336a4-cf8b-4055-96b8-d58660e2b28d admin admin] Resource SecurityGroupRule deleted: f77d817d-73f8-4f08-914e-165ded3489c2 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:11:07.964499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-45c336a4-cf8b-4055-96b8-d58660e2b28d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (f77d817d-73f8-4f08-914e-165ded3489c2), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:07.964815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-45c336a4-cf8b-4055-96b8-d58660e2b28d admin admin] Security group rule updated ['641140a8-9603-4e56-a31e-b3fa1ed9f331'] Sep 04 01:11:08.391658 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-9ba89b9c-5071-43b0-acd9-f3f02dacad82 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Resource SecurityGroup deleted: 3188d55b-e58c-4649-bc32-63a6cf0b7421 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:11:08.392184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-9ba89b9c-5071-43b0-acd9-f3f02dacad82 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (3188d55b-e58c-4649-bc32-63a6cf0b7421), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:08.392632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ba89b9c-5071-43b0-acd9-f3f02dacad82 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('3188d55b-e58c-4649-bc32-63a6cf0b7421',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:11:08.409369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-9ba89b9c-5071-43b0-acd9-f3f02dacad82 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('3188d55b-e58c-4649-bc32-63a6cf0b7421',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:11:08.409843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-9ba89b9c-5071-43b0-acd9-f3f02dacad82 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Resource SecurityGroupRule deleted: 1cc89abb-3123-4596-b9b5-f96fb43e4968 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:11:08.415385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-9ba89b9c-5071-43b0-acd9-f3f02dacad82 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (1cc89abb-3123-4596-b9b5-f96fb43e4968), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:08.415385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-9ba89b9c-5071-43b0-acd9-f3f02dacad82 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Security group rule updated ['3188d55b-e58c-4649-bc32-63a6cf0b7421'] Sep 04 01:11:08.415385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-9ba89b9c-5071-43b0-acd9-f3f02dacad82 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Resource SecurityGroupRule deleted: cab1aada-d372-46c9-8292-c25ea928acfd {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:11:08.415385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-9ba89b9c-5071-43b0-acd9-f3f02dacad82 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (cab1aada-d372-46c9-8292-c25ea928acfd), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:08.415742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-9ba89b9c-5071-43b0-acd9-f3f02dacad82 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Security group rule updated ['3188d55b-e58c-4649-bc32-63a6cf0b7421'] Sep 04 01:11:08.415742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-9ba89b9c-5071-43b0-acd9-f3f02dacad82 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Resource SecurityGroupRule deleted: 6ce442c2-88cc-4ad9-b194-f4cde28e076f {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:11:08.415742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-9ba89b9c-5071-43b0-acd9-f3f02dacad82 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (6ce442c2-88cc-4ad9-b194-f4cde28e076f), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:08.415742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-9ba89b9c-5071-43b0-acd9-f3f02dacad82 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Security group rule updated ['3188d55b-e58c-4649-bc32-63a6cf0b7421'] Sep 04 01:11:08.415742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-9ba89b9c-5071-43b0-acd9-f3f02dacad82 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Resource SecurityGroupRule deleted: da25d770-7f7b-471c-90da-935d3bac1d1d {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:11:08.416134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-9ba89b9c-5071-43b0-acd9-f3f02dacad82 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (da25d770-7f7b-471c-90da-935d3bac1d1d), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:08.416134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-9ba89b9c-5071-43b0-acd9-f3f02dacad82 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Security group rule updated ['3188d55b-e58c-4649-bc32-63a6cf0b7421'] Sep 04 01:11:08.417129 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:429 started Sep 04 01:11:08.420584 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5693,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=811000000,duration_sec=877,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:11:08.421352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:11:08.421721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:429 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 04 01:11:08.702773 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-f860356f-d466-46a7-8447-79db8cf5d2c9 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:11:08Z,description='Default security group',id=e4fd893e-3818-4eae-a725-8915df063786,is_default=True,name='default',project_id='ecc3867e695f49be92a928e0674222e2',revision_number=1,rules=[SecurityGroupRule(34ba0096-8f06-4556-8134-20974a2d052d),SecurityGroupRule(ab573280-4541-4a5e-b820-18f8ced13c97),SecurityGroupRule(dbcf3b6b-109d-4f98-9d6f-e71143c881d6),SecurityGroupRule(e910ae82-b8a1-46a4-9a16-c14a328bc9db)],shared=False,stateful=True,updated_at=2022-09-04T01:11:08Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:11:08.703780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-f860356f-d466-46a7-8447-79db8cf5d2c9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (e4fd893e-3818-4eae-a725-8915df063786), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:08.704809 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-f860356f-d466-46a7-8447-79db8cf5d2c9 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:11:08Z,description=,direction='ingress',ethertype='IPv4',id=34ba0096-8f06-4556-8134-20974a2d052d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ecc3867e695f49be92a928e0674222e2',protocol=,remote_address_group_id=,remote_group_id=e4fd893e-3818-4eae-a725-8915df063786,remote_ip_prefix=,revision_number=0,security_group_id=e4fd893e-3818-4eae-a725-8915df063786,updated_at=2022-09-04T01:11:08Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:11:08.705426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-f860356f-d466-46a7-8447-79db8cf5d2c9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (34ba0096-8f06-4556-8134-20974a2d052d), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:08.706049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-f860356f-d466-46a7-8447-79db8cf5d2c9 admin admin] Security group rule updated ['e4fd893e-3818-4eae-a725-8915df063786'] Sep 04 01:11:08.707142 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-f860356f-d466-46a7-8447-79db8cf5d2c9 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:11:08Z,description=,direction='ingress',ethertype='IPv6',id=ab573280-4541-4a5e-b820-18f8ced13c97,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ecc3867e695f49be92a928e0674222e2',protocol=,remote_address_group_id=,remote_group_id=e4fd893e-3818-4eae-a725-8915df063786,remote_ip_prefix=,revision_number=0,security_group_id=e4fd893e-3818-4eae-a725-8915df063786,updated_at=2022-09-04T01:11:08Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:11:08.707721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-f860356f-d466-46a7-8447-79db8cf5d2c9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (ab573280-4541-4a5e-b820-18f8ced13c97), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:08.708212 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-f860356f-d466-46a7-8447-79db8cf5d2c9 admin admin] Security group rule updated ['e4fd893e-3818-4eae-a725-8915df063786'] Sep 04 01:11:08.709139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-f860356f-d466-46a7-8447-79db8cf5d2c9 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:11:08Z,description=,direction='egress',ethertype='IPv4',id=dbcf3b6b-109d-4f98-9d6f-e71143c881d6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ecc3867e695f49be92a928e0674222e2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e4fd893e-3818-4eae-a725-8915df063786,updated_at=2022-09-04T01:11:08Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:11:08.711491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-f860356f-d466-46a7-8447-79db8cf5d2c9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (dbcf3b6b-109d-4f98-9d6f-e71143c881d6), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:08.712074 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-f860356f-d466-46a7-8447-79db8cf5d2c9 admin admin] Security group rule updated ['e4fd893e-3818-4eae-a725-8915df063786'] Sep 04 01:11:08.713204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-f860356f-d466-46a7-8447-79db8cf5d2c9 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:11:08Z,description=,direction='egress',ethertype='IPv6',id=e910ae82-b8a1-46a4-9a16-c14a328bc9db,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ecc3867e695f49be92a928e0674222e2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e4fd893e-3818-4eae-a725-8915df063786,updated_at=2022-09-04T01:11:08Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:11:08.714058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-f860356f-d466-46a7-8447-79db8cf5d2c9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (e910ae82-b8a1-46a4-9a16-c14a328bc9db), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:08.715216 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-f860356f-d466-46a7-8447-79db8cf5d2c9 admin admin] Security group rule updated ['e4fd893e-3818-4eae-a725-8915df063786'] Sep 04 01:11:08.892837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-157c4701-bb02-41e0-81a3-72df7b1a075d tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Resource Port deleted: 4a09384c-90bb-4ec0-9852-30a5a35f5dc0 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:11:08.893340 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-157c4701-bb02-41e0-81a3-72df7b1a075d tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (4a09384c-90bb-4ec0-9852-30a5a35f5dc0), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:08.974970 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b7925aae-7771-43b4-a79a-00108685f440 admin admin] Resource SecurityGroup deleted: e4fd893e-3818-4eae-a725-8915df063786 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:11:08.975729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b7925aae-7771-43b4-a79a-00108685f440 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (e4fd893e-3818-4eae-a725-8915df063786), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:08.976189 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7925aae-7771-43b4-a79a-00108685f440 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('e4fd893e-3818-4eae-a725-8915df063786',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:11:08.993872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b7925aae-7771-43b4-a79a-00108685f440 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('e4fd893e-3818-4eae-a725-8915df063786',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:11:08.994551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b7925aae-7771-43b4-a79a-00108685f440 admin admin] Resource SecurityGroupRule deleted: 34ba0096-8f06-4556-8134-20974a2d052d {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:11:08.995124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b7925aae-7771-43b4-a79a-00108685f440 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (34ba0096-8f06-4556-8134-20974a2d052d), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:08.995466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-b7925aae-7771-43b4-a79a-00108685f440 admin admin] Security group rule updated ['e4fd893e-3818-4eae-a725-8915df063786'] Sep 04 01:11:08.995906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b7925aae-7771-43b4-a79a-00108685f440 admin admin] Resource SecurityGroupRule deleted: ab573280-4541-4a5e-b820-18f8ced13c97 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:11:08.996243 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b7925aae-7771-43b4-a79a-00108685f440 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (ab573280-4541-4a5e-b820-18f8ced13c97), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:08.996721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-b7925aae-7771-43b4-a79a-00108685f440 admin admin] Security group rule updated ['e4fd893e-3818-4eae-a725-8915df063786'] Sep 04 01:11:08.997170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b7925aae-7771-43b4-a79a-00108685f440 admin admin] Resource SecurityGroupRule deleted: dbcf3b6b-109d-4f98-9d6f-e71143c881d6 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:11:08.997509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b7925aae-7771-43b4-a79a-00108685f440 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (dbcf3b6b-109d-4f98-9d6f-e71143c881d6), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:08.998473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-b7925aae-7771-43b4-a79a-00108685f440 admin admin] Security group rule updated ['e4fd893e-3818-4eae-a725-8915df063786'] Sep 04 01:11:08.999048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b7925aae-7771-43b4-a79a-00108685f440 admin admin] Resource SecurityGroupRule deleted: e910ae82-b8a1-46a4-9a16-c14a328bc9db {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:11:08.999391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b7925aae-7771-43b4-a79a-00108685f440 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (e910ae82-b8a1-46a4-9a16-c14a328bc9db), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:08.999701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-b7925aae-7771-43b4-a79a-00108685f440 admin admin] Security group rule updated ['e4fd893e-3818-4eae-a725-8915df063786'] Sep 04 01:11:09.437644 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c6d663d5-7a68-40eb-977c-f51c6618eb7d tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:11:09Z,description='tempest-description--566936408',id=4a7c3c8b-10d8-4cc1-bb76-bfc3e0d0e867,is_default=False,name='tempest-securitygroup--637612000',project_id='287d111f08ac4b05bd5adec9c40d0620',revision_number=1,rules=[SecurityGroupRule(7dc709b6-05e8-43f1-80f2-810dafa8a388),SecurityGroupRule(9ecebf24-15ae-4e4b-8fd0-7d3c66433f00)],shared=False,stateful=True,updated_at=2022-09-04T01:11:09Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:11:09.437644 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-c6d663d5-7a68-40eb-977c-f51c6618eb7d tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (4a7c3c8b-10d8-4cc1-bb76-bfc3e0d0e867), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:09.438188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c6d663d5-7a68-40eb-977c-f51c6618eb7d tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:11:09Z,description=,direction='egress',ethertype='IPv6',id=7dc709b6-05e8-43f1-80f2-810dafa8a388,normalized_cidr=None,port_range_max=,port_range_min=,project_id='287d111f08ac4b05bd5adec9c40d0620',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=4a7c3c8b-10d8-4cc1-bb76-bfc3e0d0e867,updated_at=2022-09-04T01:11:09Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:11:09.438550 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-c6d663d5-7a68-40eb-977c-f51c6618eb7d tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (7dc709b6-05e8-43f1-80f2-810dafa8a388), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:09.439013 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-c6d663d5-7a68-40eb-977c-f51c6618eb7d tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Security group rule updated ['4a7c3c8b-10d8-4cc1-bb76-bfc3e0d0e867'] Sep 04 01:11:09.439732 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c6d663d5-7a68-40eb-977c-f51c6618eb7d tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:11:09Z,description=,direction='egress',ethertype='IPv4',id=9ecebf24-15ae-4e4b-8fd0-7d3c66433f00,normalized_cidr=None,port_range_max=,port_range_min=,project_id='287d111f08ac4b05bd5adec9c40d0620',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=4a7c3c8b-10d8-4cc1-bb76-bfc3e0d0e867,updated_at=2022-09-04T01:11:09Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:11:09.440088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-c6d663d5-7a68-40eb-977c-f51c6618eb7d tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (9ecebf24-15ae-4e4b-8fd0-7d3c66433f00), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:09.440419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-c6d663d5-7a68-40eb-977c-f51c6618eb7d tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Security group rule updated ['4a7c3c8b-10d8-4cc1-bb76-bfc3e0d0e867'] Sep 04 01:11:09.800874 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-59a354f1-4301-4086-923d-f3034db0733f tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:11:09Z,description='',direction='ingress',ethertype='IPv4',id=973ecaf9-b003-4a4c-b650-656a00d0e985,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='287d111f08ac4b05bd5adec9c40d0620',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=4a7c3c8b-10d8-4cc1-bb76-bfc3e0d0e867,updated_at=2022-09-04T01:11:09Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:11:09.807091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-59a354f1-4301-4086-923d-f3034db0733f tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (973ecaf9-b003-4a4c-b650-656a00d0e985), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:09.807091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-59a354f1-4301-4086-923d-f3034db0733f tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Security group rule updated ['4a7c3c8b-10d8-4cc1-bb76-bfc3e0d0e867'] Sep 04 01:11:10.169116 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-973e5ccd-a9ab-46ec-9c4a-8eeb9d1b9af6 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:11:10Z,description='',direction='ingress',ethertype='IPv4',id=0cea0857-fafa-4498-b594-2f28583781fc,normalized_cidr=None,port_range_max=,port_range_min=,project_id='287d111f08ac4b05bd5adec9c40d0620',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=4a7c3c8b-10d8-4cc1-bb76-bfc3e0d0e867,updated_at=2022-09-04T01:11:10Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:11:10.169727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-973e5ccd-a9ab-46ec-9c4a-8eeb9d1b9af6 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (0cea0857-fafa-4498-b594-2f28583781fc), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:10.169937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-973e5ccd-a9ab-46ec-9c4a-8eeb9d1b9af6 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Security group rule updated ['4a7c3c8b-10d8-4cc1-bb76-bfc3e0d0e867'] Sep 04 01:11:10.418120 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:430 started Sep 04 01:11:10.420516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5695,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=812000000,duration_sec=879,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:11:10.421359 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:11:10.421686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:430 - starting polling. Elapsed:0.004 Sep 04 01:11:10.424404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:10.426530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 4a09384c-90bb-4ec0-9852-30a5a35f5dc0 not present in bridge br-int Sep 04 01:11:10.427030 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] net_uuid None not managed by VLAN manager Sep 04 01:11:10.427446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for ['4a09384c-90bb-4ec0-9852-30a5a35f5dc0'] Sep 04 01:11:10.427914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 4a09384c-90bb-4ec0-9852-30a5a35f5dc0 is not handled by the firewall. {{(pid=107812) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 04 01:11:10.431494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:430 - port information retrieved. Elapsed:0.014 Sep 04 01:11:10.432003 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:430 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.014 Sep 04 01:11:10.819350 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0fd9a4cd-21c8-4dce-bb6d-06b92056c4ed tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:11:10Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=4b9f3ca7-e9f5-4a2e-ab65-402ed81ac4dc,mac_address=fa:16:3e:72:d2:0e,name='',network_id=e8e0564a-d5c9-4fe0-b2d4-538f45096708,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(4b9f3ca7-e9f5-4a2e-ab65-402ed81ac4dc),security_group_ids=set([]),status='N/A',updated_at=2022-09-04T01:11:10Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:11:10.819918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-0fd9a4cd-21c8-4dce-bb6d-06b92056c4ed tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (4b9f3ca7-e9f5-4a2e-ab65-402ed81ac4dc), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:11.470011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0fd9a4cd-21c8-4dce-bb6d-06b92056c4ed tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Resource Port 4b9f3ca7-e9f5-4a2e-ab65-402ed81ac4dc updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': 'ee349f48-2567-44d9-9e83-458588ed82fe'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:11:11.470611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-0fd9a4cd-21c8-4dce-bb6d-06b92056c4ed tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (4b9f3ca7-e9f5-4a2e-ab65-402ed81ac4dc), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:12.419025 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:431 started Sep 04 01:11:12.423889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5697,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=814000000,duration_sec=881,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:11:12.425731 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:11:12.425731 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:431 - starting polling. Elapsed:0.006 Sep 04 01:11:12.428232 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:12.434962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:431 - port information retrieved. Elapsed:0.014 Sep 04 01:11:12.438235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:431 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.017 Sep 04 01:11:13.918716 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-98cfa312-4ad4-48eb-b838-a50cb5565167 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:11:13Z,description='Default security group',id=e847a0a2-2585-4ff1-a54c-9948af2c238f,is_default=True,name='default',project_id='116334f5d153436bae64e2cb17629671',revision_number=1,rules=[SecurityGroupRule(05863d7e-f3fa-4962-b303-70b72e5a9112),SecurityGroupRule(74e48a7e-11cb-4068-a13b-4525ba519669),SecurityGroupRule(7ed67689-bf62-400c-a330-b51e8f9e2e1c),SecurityGroupRule(aaba589b-ce4b-4a6d-ae48-c92be482ce54)],shared=False,stateful=True,updated_at=2022-09-04T01:11:13Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:11:13.925408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-98cfa312-4ad4-48eb-b838-a50cb5565167 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (e847a0a2-2585-4ff1-a54c-9948af2c238f), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:13.925691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-98cfa312-4ad4-48eb-b838-a50cb5565167 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:11:13Z,description=,direction='egress',ethertype='IPv4',id=05863d7e-f3fa-4962-b303-70b72e5a9112,normalized_cidr=None,port_range_max=,port_range_min=,project_id='116334f5d153436bae64e2cb17629671',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e847a0a2-2585-4ff1-a54c-9948af2c238f,updated_at=2022-09-04T01:11:13Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:11:13.926168 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-98cfa312-4ad4-48eb-b838-a50cb5565167 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (05863d7e-f3fa-4962-b303-70b72e5a9112), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:13.926633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-98cfa312-4ad4-48eb-b838-a50cb5565167 admin admin] Security group rule updated ['e847a0a2-2585-4ff1-a54c-9948af2c238f'] Sep 04 01:11:13.927487 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-98cfa312-4ad4-48eb-b838-a50cb5565167 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:11:13Z,description=,direction='ingress',ethertype='IPv4',id=74e48a7e-11cb-4068-a13b-4525ba519669,normalized_cidr=None,port_range_max=,port_range_min=,project_id='116334f5d153436bae64e2cb17629671',protocol=,remote_address_group_id=,remote_group_id=e847a0a2-2585-4ff1-a54c-9948af2c238f,remote_ip_prefix=,revision_number=0,security_group_id=e847a0a2-2585-4ff1-a54c-9948af2c238f,updated_at=2022-09-04T01:11:13Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:11:13.927952 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-98cfa312-4ad4-48eb-b838-a50cb5565167 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (74e48a7e-11cb-4068-a13b-4525ba519669), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:13.928384 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-98cfa312-4ad4-48eb-b838-a50cb5565167 admin admin] Security group rule updated ['e847a0a2-2585-4ff1-a54c-9948af2c238f'] Sep 04 01:11:13.929229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-98cfa312-4ad4-48eb-b838-a50cb5565167 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:11:13Z,description=,direction='egress',ethertype='IPv6',id=7ed67689-bf62-400c-a330-b51e8f9e2e1c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='116334f5d153436bae64e2cb17629671',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e847a0a2-2585-4ff1-a54c-9948af2c238f,updated_at=2022-09-04T01:11:13Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:11:13.929879 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-98cfa312-4ad4-48eb-b838-a50cb5565167 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (7ed67689-bf62-400c-a330-b51e8f9e2e1c), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:13.940333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-98cfa312-4ad4-48eb-b838-a50cb5565167 admin admin] Security group rule updated ['e847a0a2-2585-4ff1-a54c-9948af2c238f'] Sep 04 01:11:13.941294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-98cfa312-4ad4-48eb-b838-a50cb5565167 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:11:13Z,description=,direction='ingress',ethertype='IPv6',id=aaba589b-ce4b-4a6d-ae48-c92be482ce54,normalized_cidr=None,port_range_max=,port_range_min=,project_id='116334f5d153436bae64e2cb17629671',protocol=,remote_address_group_id=,remote_group_id=e847a0a2-2585-4ff1-a54c-9948af2c238f,remote_ip_prefix=,revision_number=0,security_group_id=e847a0a2-2585-4ff1-a54c-9948af2c238f,updated_at=2022-09-04T01:11:13Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:11:13.941953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-98cfa312-4ad4-48eb-b838-a50cb5565167 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (aaba589b-ce4b-4a6d-ae48-c92be482ce54), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:13.942508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-98cfa312-4ad4-48eb-b838-a50cb5565167 admin admin] Security group rule updated ['e847a0a2-2585-4ff1-a54c-9948af2c238f'] Sep 04 01:11:14.208103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-67fafc2b-92e8-4613-ba18-10ebac57d860 admin admin] Resource SecurityGroup deleted: e847a0a2-2585-4ff1-a54c-9948af2c238f {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:11:14.208103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-67fafc2b-92e8-4613-ba18-10ebac57d860 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (e847a0a2-2585-4ff1-a54c-9948af2c238f), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:14.208103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67fafc2b-92e8-4613-ba18-10ebac57d860 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('e847a0a2-2585-4ff1-a54c-9948af2c238f',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:11:14.227374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-67fafc2b-92e8-4613-ba18-10ebac57d860 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('e847a0a2-2585-4ff1-a54c-9948af2c238f',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:11:14.227871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-67fafc2b-92e8-4613-ba18-10ebac57d860 admin admin] Resource SecurityGroupRule deleted: 05863d7e-f3fa-4962-b303-70b72e5a9112 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:11:14.228248 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-67fafc2b-92e8-4613-ba18-10ebac57d860 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (05863d7e-f3fa-4962-b303-70b72e5a9112), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:14.228635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-67fafc2b-92e8-4613-ba18-10ebac57d860 admin admin] Security group rule updated ['e847a0a2-2585-4ff1-a54c-9948af2c238f'] Sep 04 01:11:14.229011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-67fafc2b-92e8-4613-ba18-10ebac57d860 admin admin] Resource SecurityGroupRule deleted: 74e48a7e-11cb-4068-a13b-4525ba519669 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:11:14.229380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-67fafc2b-92e8-4613-ba18-10ebac57d860 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (74e48a7e-11cb-4068-a13b-4525ba519669), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:14.229836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-67fafc2b-92e8-4613-ba18-10ebac57d860 admin admin] Security group rule updated ['e847a0a2-2585-4ff1-a54c-9948af2c238f'] Sep 04 01:11:14.230379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-67fafc2b-92e8-4613-ba18-10ebac57d860 admin admin] Resource SecurityGroupRule deleted: 7ed67689-bf62-400c-a330-b51e8f9e2e1c {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:11:14.230728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-67fafc2b-92e8-4613-ba18-10ebac57d860 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (7ed67689-bf62-400c-a330-b51e8f9e2e1c), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:14.231051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-67fafc2b-92e8-4613-ba18-10ebac57d860 admin admin] Security group rule updated ['e847a0a2-2585-4ff1-a54c-9948af2c238f'] Sep 04 01:11:14.231473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-67fafc2b-92e8-4613-ba18-10ebac57d860 admin admin] Resource SecurityGroupRule deleted: aaba589b-ce4b-4a6d-ae48-c92be482ce54 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:11:14.231812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-67fafc2b-92e8-4613-ba18-10ebac57d860 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (aaba589b-ce4b-4a6d-ae48-c92be482ce54), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:14.232954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-67fafc2b-92e8-4613-ba18-10ebac57d860 admin admin] Security group rule updated ['e847a0a2-2585-4ff1-a54c-9948af2c238f'] Sep 04 01:11:14.422972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:432 started Sep 04 01:11:14.431448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5699,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=822000000,duration_sec=883,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:11:14.431448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:11:14.431738 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:432 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 04 01:11:15.165968 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-8f871c70-d1c9-47bd-a02c-da76de91726f admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:11:14Z,description='Default security group',id=0af83f82-8596-4878-b9ac-a5f03f610f07,is_default=True,name='default',project_id='db8d12b797ca4982ad0ebbc95384040a',revision_number=1,rules=[SecurityGroupRule(001d26dd-9cab-41a0-b10f-1d3a3117a0fe),SecurityGroupRule(90972b2b-2709-4698-8bc2-7a387683d598),SecurityGroupRule(cf205159-84ac-4c64-b5d5-c387ed4047de),SecurityGroupRule(d01d8e7d-1fea-4510-a154-b1b15e6363f5)],shared=False,stateful=True,updated_at=2022-09-04T01:11:14Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:11:15.166662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-8f871c70-d1c9-47bd-a02c-da76de91726f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (0af83f82-8596-4878-b9ac-a5f03f610f07), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:15.167050 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-8f871c70-d1c9-47bd-a02c-da76de91726f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:11:14Z,description=,direction='egress',ethertype='IPv6',id=001d26dd-9cab-41a0-b10f-1d3a3117a0fe,normalized_cidr=None,port_range_max=,port_range_min=,project_id='db8d12b797ca4982ad0ebbc95384040a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0af83f82-8596-4878-b9ac-a5f03f610f07,updated_at=2022-09-04T01:11:14Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:11:15.167656 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-8f871c70-d1c9-47bd-a02c-da76de91726f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (001d26dd-9cab-41a0-b10f-1d3a3117a0fe), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:15.168059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-8f871c70-d1c9-47bd-a02c-da76de91726f admin admin] Security group rule updated ['0af83f82-8596-4878-b9ac-a5f03f610f07'] Sep 04 01:11:15.168936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-8f871c70-d1c9-47bd-a02c-da76de91726f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:11:14Z,description=,direction='ingress',ethertype='IPv4',id=90972b2b-2709-4698-8bc2-7a387683d598,normalized_cidr=None,port_range_max=,port_range_min=,project_id='db8d12b797ca4982ad0ebbc95384040a',protocol=,remote_address_group_id=,remote_group_id=0af83f82-8596-4878-b9ac-a5f03f610f07,remote_ip_prefix=,revision_number=0,security_group_id=0af83f82-8596-4878-b9ac-a5f03f610f07,updated_at=2022-09-04T01:11:14Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:11:15.169387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-8f871c70-d1c9-47bd-a02c-da76de91726f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (90972b2b-2709-4698-8bc2-7a387683d598), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:15.170558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-8f871c70-d1c9-47bd-a02c-da76de91726f admin admin] Security group rule updated ['0af83f82-8596-4878-b9ac-a5f03f610f07'] Sep 04 01:11:15.171458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-8f871c70-d1c9-47bd-a02c-da76de91726f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:11:14Z,description=,direction='egress',ethertype='IPv4',id=cf205159-84ac-4c64-b5d5-c387ed4047de,normalized_cidr=None,port_range_max=,port_range_min=,project_id='db8d12b797ca4982ad0ebbc95384040a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0af83f82-8596-4878-b9ac-a5f03f610f07,updated_at=2022-09-04T01:11:14Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:11:15.171883 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-8f871c70-d1c9-47bd-a02c-da76de91726f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (cf205159-84ac-4c64-b5d5-c387ed4047de), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:15.172284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-8f871c70-d1c9-47bd-a02c-da76de91726f admin admin] Security group rule updated ['0af83f82-8596-4878-b9ac-a5f03f610f07'] Sep 04 01:11:15.173065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-8f871c70-d1c9-47bd-a02c-da76de91726f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:11:14Z,description=,direction='ingress',ethertype='IPv6',id=d01d8e7d-1fea-4510-a154-b1b15e6363f5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='db8d12b797ca4982ad0ebbc95384040a',protocol=,remote_address_group_id=,remote_group_id=0af83f82-8596-4878-b9ac-a5f03f610f07,remote_ip_prefix=,revision_number=0,security_group_id=0af83f82-8596-4878-b9ac-a5f03f610f07,updated_at=2022-09-04T01:11:14Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:11:15.173522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-8f871c70-d1c9-47bd-a02c-da76de91726f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (d01d8e7d-1fea-4510-a154-b1b15e6363f5), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:15.173911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-8f871c70-d1c9-47bd-a02c-da76de91726f admin admin] Security group rule updated ['0af83f82-8596-4878-b9ac-a5f03f610f07'] Sep 04 01:11:15.362141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4fa0ce22-d123-4a26-a3f9-0c083f1ff7f6 admin admin] Resource SecurityGroup deleted: 0af83f82-8596-4878-b9ac-a5f03f610f07 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:11:15.362629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4fa0ce22-d123-4a26-a3f9-0c083f1ff7f6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (0af83f82-8596-4878-b9ac-a5f03f610f07), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:15.363212 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4fa0ce22-d123-4a26-a3f9-0c083f1ff7f6 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('0af83f82-8596-4878-b9ac-a5f03f610f07',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:11:15.377596 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4fa0ce22-d123-4a26-a3f9-0c083f1ff7f6 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('0af83f82-8596-4878-b9ac-a5f03f610f07',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:11:15.378247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4fa0ce22-d123-4a26-a3f9-0c083f1ff7f6 admin admin] Resource SecurityGroupRule deleted: 001d26dd-9cab-41a0-b10f-1d3a3117a0fe {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:11:15.378625 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4fa0ce22-d123-4a26-a3f9-0c083f1ff7f6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (001d26dd-9cab-41a0-b10f-1d3a3117a0fe), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:15.378955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-4fa0ce22-d123-4a26-a3f9-0c083f1ff7f6 admin admin] Security group rule updated ['0af83f82-8596-4878-b9ac-a5f03f610f07'] Sep 04 01:11:15.379558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4fa0ce22-d123-4a26-a3f9-0c083f1ff7f6 admin admin] Resource SecurityGroupRule deleted: 90972b2b-2709-4698-8bc2-7a387683d598 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:11:15.379907 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4fa0ce22-d123-4a26-a3f9-0c083f1ff7f6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (90972b2b-2709-4698-8bc2-7a387683d598), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:15.380225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-4fa0ce22-d123-4a26-a3f9-0c083f1ff7f6 admin admin] Security group rule updated ['0af83f82-8596-4878-b9ac-a5f03f610f07'] Sep 04 01:11:15.380641 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4fa0ce22-d123-4a26-a3f9-0c083f1ff7f6 admin admin] Resource SecurityGroupRule deleted: cf205159-84ac-4c64-b5d5-c387ed4047de {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:11:15.380980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4fa0ce22-d123-4a26-a3f9-0c083f1ff7f6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (cf205159-84ac-4c64-b5d5-c387ed4047de), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:15.381859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-4fa0ce22-d123-4a26-a3f9-0c083f1ff7f6 admin admin] Security group rule updated ['0af83f82-8596-4878-b9ac-a5f03f610f07'] Sep 04 01:11:15.382281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4fa0ce22-d123-4a26-a3f9-0c083f1ff7f6 admin admin] Resource SecurityGroupRule deleted: d01d8e7d-1fea-4510-a154-b1b15e6363f5 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:11:15.382737 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4fa0ce22-d123-4a26-a3f9-0c083f1ff7f6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (d01d8e7d-1fea-4510-a154-b1b15e6363f5), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:15.383057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-4fa0ce22-d123-4a26-a3f9-0c083f1ff7f6 admin admin] Security group rule updated ['0af83f82-8596-4878-b9ac-a5f03f610f07'] Sep 04 01:11:15.824266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-9d74c530-2b9b-4027-9b39-f94804248ac1 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:11:15Z,data_plane_status=None,description='',device_id='2718d3b6-c71c-4ae1-9544-0f8e4a43d989',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=a684da0f-7a2f-4974-8aa3-30875caa5a0e,mac_address=fa:16:3e:17:12:29,name='',network_id=d7f39628-666e-4480-8bee-49de183d5e09,numa_affinity_policy=,project_id='287d111f08ac4b05bd5adec9c40d0620',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(a684da0f-7a2f-4974-8aa3-30875caa5a0e),security_group_ids=set([4a7c3c8b-10d8-4cc1-bb76-bfc3e0d0e867]),status='DOWN',updated_at=2022-09-04T01:11:15Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:11:15.824885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-9d74c530-2b9b-4027-9b39-f94804248ac1 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (a684da0f-7a2f-4974-8aa3-30875caa5a0e), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:15.825572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-9d74c530-2b9b-4027-9b39-f94804248ac1 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Security group member updated {'4a7c3c8b-10d8-4cc1-bb76-bfc3e0d0e867'} Sep 04 01:11:16.423481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:433 started Sep 04 01:11:16.426333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade569b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=818000000,duration_sec=885,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:11:16.426925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:11:16.428312 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:433 - starting polling. Elapsed:0.005 Sep 04 01:11:16.432566 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:16.437388 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:433 - port information retrieved. Elapsed:0.014 Sep 04 01:11:16.437756 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:433 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.014 Sep 04 01:11:16.558859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b233f65d-cc53-430b-8384-38f50990018e service neutron] Resource Port a684da0f-7a2f-4974-8aa3-30875caa5a0e updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=a684da0f-7a2f-4974-8aa3-30875caa5a0e,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=a684da0f-7a2f-4974-8aa3-30875caa5a0e,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:11:16.559703 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b233f65d-cc53-430b-8384-38f50990018e service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (a684da0f-7a2f-4974-8aa3-30875caa5a0e), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:16.853238 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b233f65d-cc53-430b-8384-38f50990018e service neutron] Resource Port a684da0f-7a2f-4974-8aa3-30875caa5a0e updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=a684da0f-7a2f-4974-8aa3-30875caa5a0e,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=a684da0f-7a2f-4974-8aa3-30875caa5a0e,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=a684da0f-7a2f-4974-8aa3-30875caa5a0e,segment=NetworkSegment(929a573e-75ef-46ab-9889-4a31869bd81c),segment_id=929a573e-75ef-46ab-9889-4a31869bd81c)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:11:16.853843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b233f65d-cc53-430b-8384-38f50990018e service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (a684da0f-7a2f-4974-8aa3-30875caa5a0e), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:18.424575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:434 started Sep 04 01:11:18.428083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade569d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=819000000,duration_sec=887,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:11:18.428856 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:11:18.429287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:434 - starting polling. Elapsed:0.005 Sep 04 01:11:18.431908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:18.436088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:434 - port information retrieved. Elapsed:0.011 Sep 04 01:11:18.436713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:434 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Sep 04 01:11:20.425719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:435 started Sep 04 01:11:20.428530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade569f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=820000000,duration_sec=889,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:11:20.429187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:11:20.429782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:435 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:11:21.868249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Resource Port 19f203f1-14db-4bb0-aaad-c8e57c75d249 updated (revision_number 5->6). Old fields: {'status': 'ACTIVE'} New fields: {'status': 'BUILD'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:11:21.872589 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (19f203f1-14db-4bb0-aaad-c8e57c75d249), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:22.130690 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Resource Port a684da0f-7a2f-4974-8aa3-30875caa5a0e updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:11:22.131067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (a684da0f-7a2f-4974-8aa3-30875caa5a0e), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:22.431869 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:436 started Sep 04 01:11:22.438785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade56a1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=828000000,duration_sec=891,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:11:22.440124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:11:22.440968 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:436 - starting polling. Elapsed:0.009 Sep 04 01:11:22.448327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:22.479381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:436 - port information retrieved. Elapsed:0.048 Sep 04 01:11:22.479725 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:436 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.048 Sep 04 01:11:24.001664 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Resource Port a684da0f-7a2f-4974-8aa3-30875caa5a0e updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:11:24.002243 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (a684da0f-7a2f-4974-8aa3-30875caa5a0e), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:24.345441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Resource Port 19f203f1-14db-4bb0-aaad-c8e57c75d249 updated (revision_number 6->7). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:11:24.345908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (19f203f1-14db-4bb0-aaad-c8e57c75d249), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:24.433212 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:437 started Sep 04 01:11:24.436059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade56a3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=827000000,duration_sec=893,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:11:24.436937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:11:24.437446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:437 - starting polling. Elapsed:0.004 Sep 04 01:11:24.440130 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:24.443642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:437 - port information retrieved. Elapsed:0.011 Sep 04 01:11:24.443979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:437 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 04 01:11:26.102238 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-812ac1eb-9331-435a-a6c2-6bed99cb1904 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:11:25Z,description='Default security group',id=29c59997-1578-4ff6-9395-96545a3e30ef,is_default=True,name='default',project_id='51bc35cf23b04168b0ce60cec276724f',revision_number=1,rules=[SecurityGroupRule(65d7cec6-326e-4430-9618-cdb5facc1677),SecurityGroupRule(a44c1c4c-4629-4af4-b731-1be3a4ecf3a9),SecurityGroupRule(b241cdcc-d449-4268-9553-ba2d3f1b11ea),SecurityGroupRule(b369671c-8afc-4484-8c73-14c96cb4d978)],shared=False,stateful=True,updated_at=2022-09-04T01:11:25Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:11:26.102936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-812ac1eb-9331-435a-a6c2-6bed99cb1904 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (29c59997-1578-4ff6-9395-96545a3e30ef), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:26.103985 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-812ac1eb-9331-435a-a6c2-6bed99cb1904 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:11:25Z,description=,direction='ingress',ethertype='IPv4',id=65d7cec6-326e-4430-9618-cdb5facc1677,normalized_cidr=None,port_range_max=,port_range_min=,project_id='51bc35cf23b04168b0ce60cec276724f',protocol=,remote_address_group_id=,remote_group_id=29c59997-1578-4ff6-9395-96545a3e30ef,remote_ip_prefix=,revision_number=0,security_group_id=29c59997-1578-4ff6-9395-96545a3e30ef,updated_at=2022-09-04T01:11:25Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:11:26.104613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-812ac1eb-9331-435a-a6c2-6bed99cb1904 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (65d7cec6-326e-4430-9618-cdb5facc1677), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:26.105862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-812ac1eb-9331-435a-a6c2-6bed99cb1904 admin admin] Security group rule updated ['29c59997-1578-4ff6-9395-96545a3e30ef'] Sep 04 01:11:26.116626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-812ac1eb-9331-435a-a6c2-6bed99cb1904 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:11:25Z,description=,direction='ingress',ethertype='IPv6',id=a44c1c4c-4629-4af4-b731-1be3a4ecf3a9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='51bc35cf23b04168b0ce60cec276724f',protocol=,remote_address_group_id=,remote_group_id=29c59997-1578-4ff6-9395-96545a3e30ef,remote_ip_prefix=,revision_number=0,security_group_id=29c59997-1578-4ff6-9395-96545a3e30ef,updated_at=2022-09-04T01:11:25Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:11:26.117011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-812ac1eb-9331-435a-a6c2-6bed99cb1904 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (a44c1c4c-4629-4af4-b731-1be3a4ecf3a9), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:26.117685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-812ac1eb-9331-435a-a6c2-6bed99cb1904 admin admin] Security group rule updated ['29c59997-1578-4ff6-9395-96545a3e30ef'] Sep 04 01:11:26.118964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-812ac1eb-9331-435a-a6c2-6bed99cb1904 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:11:25Z,description=,direction='egress',ethertype='IPv4',id=b241cdcc-d449-4268-9553-ba2d3f1b11ea,normalized_cidr=None,port_range_max=,port_range_min=,project_id='51bc35cf23b04168b0ce60cec276724f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=29c59997-1578-4ff6-9395-96545a3e30ef,updated_at=2022-09-04T01:11:25Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:11:26.119722 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-812ac1eb-9331-435a-a6c2-6bed99cb1904 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (b241cdcc-d449-4268-9553-ba2d3f1b11ea), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:26.120222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-812ac1eb-9331-435a-a6c2-6bed99cb1904 admin admin] Security group rule updated ['29c59997-1578-4ff6-9395-96545a3e30ef'] Sep 04 01:11:26.126182 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-812ac1eb-9331-435a-a6c2-6bed99cb1904 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:11:25Z,description=,direction='egress',ethertype='IPv6',id=b369671c-8afc-4484-8c73-14c96cb4d978,normalized_cidr=None,port_range_max=,port_range_min=,project_id='51bc35cf23b04168b0ce60cec276724f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=29c59997-1578-4ff6-9395-96545a3e30ef,updated_at=2022-09-04T01:11:25Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:11:26.127249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-812ac1eb-9331-435a-a6c2-6bed99cb1904 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (b369671c-8afc-4484-8c73-14c96cb4d978), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:26.127810 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-812ac1eb-9331-435a-a6c2-6bed99cb1904 admin admin] Security group rule updated ['29c59997-1578-4ff6-9395-96545a3e30ef'] Sep 04 01:11:26.383494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-6d17524b-36bb-4d11-8dd8-b1ae39b70b27 admin admin] Resource SecurityGroup deleted: 29c59997-1578-4ff6-9395-96545a3e30ef {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:11:26.383948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-6d17524b-36bb-4d11-8dd8-b1ae39b70b27 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (29c59997-1578-4ff6-9395-96545a3e30ef), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:26.384560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d17524b-36bb-4d11-8dd8-b1ae39b70b27 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('29c59997-1578-4ff6-9395-96545a3e30ef',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:11:26.403618 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-6d17524b-36bb-4d11-8dd8-b1ae39b70b27 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('29c59997-1578-4ff6-9395-96545a3e30ef',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:11:26.405037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-6d17524b-36bb-4d11-8dd8-b1ae39b70b27 admin admin] Resource SecurityGroupRule deleted: 65d7cec6-326e-4430-9618-cdb5facc1677 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:11:26.405797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-6d17524b-36bb-4d11-8dd8-b1ae39b70b27 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (65d7cec6-326e-4430-9618-cdb5facc1677), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:26.406577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-6d17524b-36bb-4d11-8dd8-b1ae39b70b27 admin admin] Security group rule updated ['29c59997-1578-4ff6-9395-96545a3e30ef'] Sep 04 01:11:26.407666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-6d17524b-36bb-4d11-8dd8-b1ae39b70b27 admin admin] Resource SecurityGroupRule deleted: a44c1c4c-4629-4af4-b731-1be3a4ecf3a9 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:11:26.408369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-6d17524b-36bb-4d11-8dd8-b1ae39b70b27 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (a44c1c4c-4629-4af4-b731-1be3a4ecf3a9), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:26.409790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-6d17524b-36bb-4d11-8dd8-b1ae39b70b27 admin admin] Security group rule updated ['29c59997-1578-4ff6-9395-96545a3e30ef'] Sep 04 01:11:26.410308 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-6d17524b-36bb-4d11-8dd8-b1ae39b70b27 admin admin] Resource SecurityGroupRule deleted: b241cdcc-d449-4268-9553-ba2d3f1b11ea {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:11:26.410737 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-6d17524b-36bb-4d11-8dd8-b1ae39b70b27 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (b241cdcc-d449-4268-9553-ba2d3f1b11ea), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:26.411130 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-6d17524b-36bb-4d11-8dd8-b1ae39b70b27 admin admin] Security group rule updated ['29c59997-1578-4ff6-9395-96545a3e30ef'] Sep 04 01:11:26.412038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-6d17524b-36bb-4d11-8dd8-b1ae39b70b27 admin admin] Resource SecurityGroupRule deleted: b369671c-8afc-4484-8c73-14c96cb4d978 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:11:26.412389 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-6d17524b-36bb-4d11-8dd8-b1ae39b70b27 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (b369671c-8afc-4484-8c73-14c96cb4d978), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:26.413111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-6d17524b-36bb-4d11-8dd8-b1ae39b70b27 admin admin] Security group rule updated ['29c59997-1578-4ff6-9395-96545a3e30ef'] Sep 04 01:11:26.435082 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:438 started Sep 04 01:11:26.438132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade56a5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=830000000,duration_sec=895,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:11:26.438706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:11:26.439060 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:438 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:11:27.473171 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-405a660b-a7ae-48aa-a7d8-922e6e9d52f6 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:11:27Z,description='Default security group',id=18fbc458-bb5b-4fd0-80ed-a8db4ac5a4c8,is_default=True,name='default',project_id='85eb051f40134bc287ff73cd0f2ffb00',revision_number=1,rules=[SecurityGroupRule(6db36b9c-64f2-4adc-8177-e616a04c37de),SecurityGroupRule(82ae0814-53d8-4ebd-ad8c-de2fcc3965a3),SecurityGroupRule(8f49d00c-cbad-47df-a610-1f23bd8143db),SecurityGroupRule(f16f6245-606a-4c35-abb2-0b2d79d99d0a)],shared=False,stateful=True,updated_at=2022-09-04T01:11:27Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:11:27.473728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-405a660b-a7ae-48aa-a7d8-922e6e9d52f6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (18fbc458-bb5b-4fd0-80ed-a8db4ac5a4c8), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:27.474182 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-405a660b-a7ae-48aa-a7d8-922e6e9d52f6 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:11:27Z,description=,direction='ingress',ethertype='IPv4',id=6db36b9c-64f2-4adc-8177-e616a04c37de,normalized_cidr=None,port_range_max=,port_range_min=,project_id='85eb051f40134bc287ff73cd0f2ffb00',protocol=,remote_address_group_id=,remote_group_id=18fbc458-bb5b-4fd0-80ed-a8db4ac5a4c8,remote_ip_prefix=,revision_number=0,security_group_id=18fbc458-bb5b-4fd0-80ed-a8db4ac5a4c8,updated_at=2022-09-04T01:11:27Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:11:27.474550 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-405a660b-a7ae-48aa-a7d8-922e6e9d52f6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (6db36b9c-64f2-4adc-8177-e616a04c37de), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:27.474893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-405a660b-a7ae-48aa-a7d8-922e6e9d52f6 admin admin] Security group rule updated ['18fbc458-bb5b-4fd0-80ed-a8db4ac5a4c8'] Sep 04 01:11:27.475983 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-405a660b-a7ae-48aa-a7d8-922e6e9d52f6 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:11:27Z,description=,direction='egress',ethertype='IPv4',id=82ae0814-53d8-4ebd-ad8c-de2fcc3965a3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='85eb051f40134bc287ff73cd0f2ffb00',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=18fbc458-bb5b-4fd0-80ed-a8db4ac5a4c8,updated_at=2022-09-04T01:11:27Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:11:27.476346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-405a660b-a7ae-48aa-a7d8-922e6e9d52f6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (82ae0814-53d8-4ebd-ad8c-de2fcc3965a3), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:27.476799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-405a660b-a7ae-48aa-a7d8-922e6e9d52f6 admin admin] Security group rule updated ['18fbc458-bb5b-4fd0-80ed-a8db4ac5a4c8'] Sep 04 01:11:27.477875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-405a660b-a7ae-48aa-a7d8-922e6e9d52f6 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:11:27Z,description=,direction='ingress',ethertype='IPv6',id=8f49d00c-cbad-47df-a610-1f23bd8143db,normalized_cidr=None,port_range_max=,port_range_min=,project_id='85eb051f40134bc287ff73cd0f2ffb00',protocol=,remote_address_group_id=,remote_group_id=18fbc458-bb5b-4fd0-80ed-a8db4ac5a4c8,remote_ip_prefix=,revision_number=0,security_group_id=18fbc458-bb5b-4fd0-80ed-a8db4ac5a4c8,updated_at=2022-09-04T01:11:27Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:11:27.484902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-405a660b-a7ae-48aa-a7d8-922e6e9d52f6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (8f49d00c-cbad-47df-a610-1f23bd8143db), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:27.484902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-405a660b-a7ae-48aa-a7d8-922e6e9d52f6 admin admin] Security group rule updated ['18fbc458-bb5b-4fd0-80ed-a8db4ac5a4c8'] Sep 04 01:11:27.484902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-405a660b-a7ae-48aa-a7d8-922e6e9d52f6 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:11:27Z,description=,direction='egress',ethertype='IPv6',id=f16f6245-606a-4c35-abb2-0b2d79d99d0a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='85eb051f40134bc287ff73cd0f2ffb00',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=18fbc458-bb5b-4fd0-80ed-a8db4ac5a4c8,updated_at=2022-09-04T01:11:27Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:11:27.484902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-405a660b-a7ae-48aa-a7d8-922e6e9d52f6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (f16f6245-606a-4c35-abb2-0b2d79d99d0a), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:27.485372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-405a660b-a7ae-48aa-a7d8-922e6e9d52f6 admin admin] Security group rule updated ['18fbc458-bb5b-4fd0-80ed-a8db4ac5a4c8'] Sep 04 01:11:27.753679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-844477e2-877c-4fb3-afeb-5483d9585798 admin admin] Resource SecurityGroup deleted: 18fbc458-bb5b-4fd0-80ed-a8db4ac5a4c8 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:11:27.757100 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-844477e2-877c-4fb3-afeb-5483d9585798 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (18fbc458-bb5b-4fd0-80ed-a8db4ac5a4c8), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:27.757100 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-844477e2-877c-4fb3-afeb-5483d9585798 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('18fbc458-bb5b-4fd0-80ed-a8db4ac5a4c8',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:11:27.771115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-844477e2-877c-4fb3-afeb-5483d9585798 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('18fbc458-bb5b-4fd0-80ed-a8db4ac5a4c8',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:11:27.773054 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-844477e2-877c-4fb3-afeb-5483d9585798 admin admin] Resource SecurityGroupRule deleted: 6db36b9c-64f2-4adc-8177-e616a04c37de {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:11:27.773599 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-844477e2-877c-4fb3-afeb-5483d9585798 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (6db36b9c-64f2-4adc-8177-e616a04c37de), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:27.775070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-844477e2-877c-4fb3-afeb-5483d9585798 admin admin] Security group rule updated ['18fbc458-bb5b-4fd0-80ed-a8db4ac5a4c8'] Sep 04 01:11:27.775944 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-844477e2-877c-4fb3-afeb-5483d9585798 admin admin] Resource SecurityGroupRule deleted: 82ae0814-53d8-4ebd-ad8c-de2fcc3965a3 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:11:27.776325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-844477e2-877c-4fb3-afeb-5483d9585798 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (82ae0814-53d8-4ebd-ad8c-de2fcc3965a3), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:27.776698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-844477e2-877c-4fb3-afeb-5483d9585798 admin admin] Security group rule updated ['18fbc458-bb5b-4fd0-80ed-a8db4ac5a4c8'] Sep 04 01:11:27.779922 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-844477e2-877c-4fb3-afeb-5483d9585798 admin admin] Resource SecurityGroupRule deleted: 8f49d00c-cbad-47df-a610-1f23bd8143db {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:11:27.785796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-844477e2-877c-4fb3-afeb-5483d9585798 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (8f49d00c-cbad-47df-a610-1f23bd8143db), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:27.785796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-844477e2-877c-4fb3-afeb-5483d9585798 admin admin] Security group rule updated ['18fbc458-bb5b-4fd0-80ed-a8db4ac5a4c8'] Sep 04 01:11:27.785796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-844477e2-877c-4fb3-afeb-5483d9585798 admin admin] Resource SecurityGroupRule deleted: f16f6245-606a-4c35-abb2-0b2d79d99d0a {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:11:27.785796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-844477e2-877c-4fb3-afeb-5483d9585798 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (f16f6245-606a-4c35-abb2-0b2d79d99d0a), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:27.785796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-844477e2-877c-4fb3-afeb-5483d9585798 admin admin] Security group rule updated ['18fbc458-bb5b-4fd0-80ed-a8db4ac5a4c8'] Sep 04 01:11:28.438533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:439 started Sep 04 01:11:28.442420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade56a7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=833000000,duration_sec=897,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:11:28.443469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:11:28.444066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:439 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 04 01:11:30.439838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:440 started Sep 04 01:11:30.442285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade56a9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=834000000,duration_sec=899,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:11:30.442879 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:11:30.443221 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:440 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:11:32.441783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:441 started Sep 04 01:11:32.444289 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade56ab,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=836000000,duration_sec=901,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:11:32.444926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:11:32.445675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:441 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 04 01:11:34.442962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:442 started Sep 04 01:11:34.445394 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade56ad,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=837000000,duration_sec=903,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:11:34.446002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:11:34.446526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:442 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:11:36.444291 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:443 started Sep 04 01:11:36.446785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade56af,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=838000000,duration_sec=905,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:11:36.447408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:11:36.447782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:443 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:11:37.892096 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Resource Port 19f203f1-14db-4bb0-aaad-c8e57c75d249 updated (revision_number 7->8). Old fields: {'status': 'ACTIVE'} New fields: {'status': 'DOWN'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:11:37.892811 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (19f203f1-14db-4bb0-aaad-c8e57c75d249), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:38.445250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:444 started Sep 04 01:11:38.447838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade56b1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=839000000,duration_sec=907,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:11:38.448411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:11:38.448771 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:444 - starting polling. Elapsed:0.004 Sep 04 01:11:38.451500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:38.454983 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:444 - port information retrieved. Elapsed:0.010 Sep 04 01:11:38.455322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:444 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Sep 04 01:11:40.446552 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:445 started Sep 04 01:11:40.449369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade56b3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=841000000,duration_sec=909,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:11:40.449943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:11:40.450292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:445 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:11:42.448082 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:446 started Sep 04 01:11:42.450494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade56b5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=842000000,duration_sec=911,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:11:42.451679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:11:42.452051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:446 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:11:44.449704 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:447 started Sep 04 01:11:44.454060 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade56b7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=845000000,duration_sec=913,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:11:44.454630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:11:44.454981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:447 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 04 01:11:46.451196 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:448 started Sep 04 01:11:46.455273 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade56b9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=847000000,duration_sec=915,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:11:46.455956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:11:46.456366 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:448 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 04 01:11:48.452065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:449 started Sep 04 01:11:48.454624 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade56bb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=846000000,duration_sec=917,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:11:48.455192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:11:48.455562 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:449 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:11:49.572910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c42395c7-ed82-44fe-9ab5-1873dc0477f0 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:11:48Z,description='Default security group',id=00c843c2-a104-4675-b55b-9ede24de3e66,is_default=True,name='default',project_id='57b717c160e64aca8571ae6cbeeee26c',revision_number=1,rules=[SecurityGroupRule(2b213dd2-a173-46e7-bab6-192b8bfef26f),SecurityGroupRule(3d3af824-7d4a-46dd-9a66-2058c2f79f6e),SecurityGroupRule(649c7639-d456-4911-92ba-be7a83068585),SecurityGroupRule(b2bb21ae-b2b5-40d7-8c8a-68ad037ae05a)],shared=False,stateful=True,updated_at=2022-09-04T01:11:48Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:11:49.574082 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-c42395c7-ed82-44fe-9ab5-1873dc0477f0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (00c843c2-a104-4675-b55b-9ede24de3e66), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:49.574945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c42395c7-ed82-44fe-9ab5-1873dc0477f0 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:11:48Z,description=,direction='egress',ethertype='IPv6',id=2b213dd2-a173-46e7-bab6-192b8bfef26f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='57b717c160e64aca8571ae6cbeeee26c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=00c843c2-a104-4675-b55b-9ede24de3e66,updated_at=2022-09-04T01:11:48Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:11:49.575673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-c42395c7-ed82-44fe-9ab5-1873dc0477f0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (2b213dd2-a173-46e7-bab6-192b8bfef26f), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:49.576170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-c42395c7-ed82-44fe-9ab5-1873dc0477f0 admin admin] Security group rule updated ['00c843c2-a104-4675-b55b-9ede24de3e66'] Sep 04 01:11:49.577796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c42395c7-ed82-44fe-9ab5-1873dc0477f0 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:11:48Z,description=,direction='ingress',ethertype='IPv4',id=3d3af824-7d4a-46dd-9a66-2058c2f79f6e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='57b717c160e64aca8571ae6cbeeee26c',protocol=,remote_address_group_id=,remote_group_id=00c843c2-a104-4675-b55b-9ede24de3e66,remote_ip_prefix=,revision_number=0,security_group_id=00c843c2-a104-4675-b55b-9ede24de3e66,updated_at=2022-09-04T01:11:48Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:11:49.578351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-c42395c7-ed82-44fe-9ab5-1873dc0477f0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (3d3af824-7d4a-46dd-9a66-2058c2f79f6e), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:49.578881 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-c42395c7-ed82-44fe-9ab5-1873dc0477f0 admin admin] Security group rule updated ['00c843c2-a104-4675-b55b-9ede24de3e66'] Sep 04 01:11:49.579753 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c42395c7-ed82-44fe-9ab5-1873dc0477f0 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:11:48Z,description=,direction='egress',ethertype='IPv4',id=649c7639-d456-4911-92ba-be7a83068585,normalized_cidr=None,port_range_max=,port_range_min=,project_id='57b717c160e64aca8571ae6cbeeee26c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=00c843c2-a104-4675-b55b-9ede24de3e66,updated_at=2022-09-04T01:11:48Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:11:49.580332 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-c42395c7-ed82-44fe-9ab5-1873dc0477f0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (649c7639-d456-4911-92ba-be7a83068585), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:49.580824 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-c42395c7-ed82-44fe-9ab5-1873dc0477f0 admin admin] Security group rule updated ['00c843c2-a104-4675-b55b-9ede24de3e66'] Sep 04 01:11:49.581731 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c42395c7-ed82-44fe-9ab5-1873dc0477f0 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:11:48Z,description=,direction='ingress',ethertype='IPv6',id=b2bb21ae-b2b5-40d7-8c8a-68ad037ae05a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='57b717c160e64aca8571ae6cbeeee26c',protocol=,remote_address_group_id=,remote_group_id=00c843c2-a104-4675-b55b-9ede24de3e66,remote_ip_prefix=,revision_number=0,security_group_id=00c843c2-a104-4675-b55b-9ede24de3e66,updated_at=2022-09-04T01:11:48Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:11:49.582089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-c42395c7-ed82-44fe-9ab5-1873dc0477f0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (b2bb21ae-b2b5-40d7-8c8a-68ad037ae05a), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:49.582446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-c42395c7-ed82-44fe-9ab5-1873dc0477f0 admin admin] Security group rule updated ['00c843c2-a104-4675-b55b-9ede24de3e66'] Sep 04 01:11:49.825661 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-3f6e40c7-f3ea-4798-9f70-f1a367dcfd77 admin admin] Resource SecurityGroup deleted: 00c843c2-a104-4675-b55b-9ede24de3e66 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:11:49.826847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-3f6e40c7-f3ea-4798-9f70-f1a367dcfd77 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (00c843c2-a104-4675-b55b-9ede24de3e66), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:49.828256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f6e40c7-f3ea-4798-9f70-f1a367dcfd77 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('00c843c2-a104-4675-b55b-9ede24de3e66',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:11:49.845756 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-3f6e40c7-f3ea-4798-9f70-f1a367dcfd77 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('00c843c2-a104-4675-b55b-9ede24de3e66',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:11:49.846605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-3f6e40c7-f3ea-4798-9f70-f1a367dcfd77 admin admin] Resource SecurityGroupRule deleted: 2b213dd2-a173-46e7-bab6-192b8bfef26f {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:11:49.847174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-3f6e40c7-f3ea-4798-9f70-f1a367dcfd77 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (2b213dd2-a173-46e7-bab6-192b8bfef26f), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:49.847755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-3f6e40c7-f3ea-4798-9f70-f1a367dcfd77 admin admin] Security group rule updated ['00c843c2-a104-4675-b55b-9ede24de3e66'] Sep 04 01:11:49.848353 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-3f6e40c7-f3ea-4798-9f70-f1a367dcfd77 admin admin] Resource SecurityGroupRule deleted: 3d3af824-7d4a-46dd-9a66-2058c2f79f6e {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:11:49.848844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-3f6e40c7-f3ea-4798-9f70-f1a367dcfd77 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (3d3af824-7d4a-46dd-9a66-2058c2f79f6e), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:49.849367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-3f6e40c7-f3ea-4798-9f70-f1a367dcfd77 admin admin] Security group rule updated ['00c843c2-a104-4675-b55b-9ede24de3e66'] Sep 04 01:11:49.850178 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-3f6e40c7-f3ea-4798-9f70-f1a367dcfd77 admin admin] Resource SecurityGroupRule deleted: 649c7639-d456-4911-92ba-be7a83068585 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:11:49.850766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-3f6e40c7-f3ea-4798-9f70-f1a367dcfd77 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (649c7639-d456-4911-92ba-be7a83068585), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:49.851278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-3f6e40c7-f3ea-4798-9f70-f1a367dcfd77 admin admin] Security group rule updated ['00c843c2-a104-4675-b55b-9ede24de3e66'] Sep 04 01:11:49.852135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-3f6e40c7-f3ea-4798-9f70-f1a367dcfd77 admin admin] Resource SecurityGroupRule deleted: b2bb21ae-b2b5-40d7-8c8a-68ad037ae05a {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:11:49.852700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-3f6e40c7-f3ea-4798-9f70-f1a367dcfd77 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (b2bb21ae-b2b5-40d7-8c8a-68ad037ae05a), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:49.853105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-3f6e40c7-f3ea-4798-9f70-f1a367dcfd77 admin admin] Security group rule updated ['00c843c2-a104-4675-b55b-9ede24de3e66'] Sep 04 01:11:50.452800 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:450 started Sep 04 01:11:50.455825 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade56bd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=847000000,duration_sec=919,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:11:50.456580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:11:50.463157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:450 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 04 01:11:52.460112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:451 started Sep 04 01:11:52.464070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade56bf,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=855000000,duration_sec=921,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:11:52.465541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:11:52.465886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:451 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 04 01:11:54.476721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:452 started Sep 04 01:11:54.476721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade56c1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=855000000,duration_sec=923,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:11:54.476721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:11:54.476721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:452 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 04 01:11:56.056203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-98fddfab-ece6-47c1-9716-12c3376ceb6b admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:11:55Z,description='Default security group',id=3073c0dd-558d-441d-9baf-8372f45e944c,is_default=True,name='default',project_id='8758a3c4d7334a51a1615b94f7cf10b2',revision_number=1,rules=[SecurityGroupRule(b235d275-0919-470e-ae5e-28257f1900e9),SecurityGroupRule(b50dd489-cf9d-49f4-b9db-9648b0b80027),SecurityGroupRule(c81e6a00-3faf-40bf-981d-fa39e8dfe2c1),SecurityGroupRule(eba93b3b-53b1-49d3-abcc-362c7b9751ae)],shared=False,stateful=True,updated_at=2022-09-04T01:11:55Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:11:56.056830 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-98fddfab-ece6-47c1-9716-12c3376ceb6b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (3073c0dd-558d-441d-9baf-8372f45e944c), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:56.057243 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-98fddfab-ece6-47c1-9716-12c3376ceb6b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:11:55Z,description=,direction='ingress',ethertype='IPv4',id=b235d275-0919-470e-ae5e-28257f1900e9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8758a3c4d7334a51a1615b94f7cf10b2',protocol=,remote_address_group_id=,remote_group_id=3073c0dd-558d-441d-9baf-8372f45e944c,remote_ip_prefix=,revision_number=0,security_group_id=3073c0dd-558d-441d-9baf-8372f45e944c,updated_at=2022-09-04T01:11:55Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:11:56.057613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-98fddfab-ece6-47c1-9716-12c3376ceb6b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (b235d275-0919-470e-ae5e-28257f1900e9), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:56.057958 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-98fddfab-ece6-47c1-9716-12c3376ceb6b admin admin] Security group rule updated ['3073c0dd-558d-441d-9baf-8372f45e944c'] Sep 04 01:11:56.058674 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-98fddfab-ece6-47c1-9716-12c3376ceb6b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:11:55Z,description=,direction='egress',ethertype='IPv4',id=b50dd489-cf9d-49f4-b9db-9648b0b80027,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8758a3c4d7334a51a1615b94f7cf10b2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=3073c0dd-558d-441d-9baf-8372f45e944c,updated_at=2022-09-04T01:11:55Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:11:56.059034 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-98fddfab-ece6-47c1-9716-12c3376ceb6b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (b50dd489-cf9d-49f4-b9db-9648b0b80027), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:56.059368 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-98fddfab-ece6-47c1-9716-12c3376ceb6b admin admin] Security group rule updated ['3073c0dd-558d-441d-9baf-8372f45e944c'] Sep 04 01:11:56.060083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-98fddfab-ece6-47c1-9716-12c3376ceb6b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:11:55Z,description=,direction='ingress',ethertype='IPv6',id=c81e6a00-3faf-40bf-981d-fa39e8dfe2c1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8758a3c4d7334a51a1615b94f7cf10b2',protocol=,remote_address_group_id=,remote_group_id=3073c0dd-558d-441d-9baf-8372f45e944c,remote_ip_prefix=,revision_number=0,security_group_id=3073c0dd-558d-441d-9baf-8372f45e944c,updated_at=2022-09-04T01:11:55Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:11:56.060439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-98fddfab-ece6-47c1-9716-12c3376ceb6b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (c81e6a00-3faf-40bf-981d-fa39e8dfe2c1), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:56.061434 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-98fddfab-ece6-47c1-9716-12c3376ceb6b admin admin] Security group rule updated ['3073c0dd-558d-441d-9baf-8372f45e944c'] Sep 04 01:11:56.062145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-98fddfab-ece6-47c1-9716-12c3376ceb6b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:11:55Z,description=,direction='egress',ethertype='IPv6',id=eba93b3b-53b1-49d3-abcc-362c7b9751ae,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8758a3c4d7334a51a1615b94f7cf10b2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=3073c0dd-558d-441d-9baf-8372f45e944c,updated_at=2022-09-04T01:11:55Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:11:56.062499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-98fddfab-ece6-47c1-9716-12c3376ceb6b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (eba93b3b-53b1-49d3-abcc-362c7b9751ae), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:56.062829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-98fddfab-ece6-47c1-9716-12c3376ceb6b admin admin] Security group rule updated ['3073c0dd-558d-441d-9baf-8372f45e944c'] Sep 04 01:11:56.253220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0a4d50ce-e152-4727-be9d-e88fd08d47e7 admin admin] Resource SecurityGroup deleted: 3073c0dd-558d-441d-9baf-8372f45e944c {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:11:56.253601 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-0a4d50ce-e152-4727-be9d-e88fd08d47e7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (3073c0dd-558d-441d-9baf-8372f45e944c), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:56.254057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a4d50ce-e152-4727-be9d-e88fd08d47e7 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('3073c0dd-558d-441d-9baf-8372f45e944c',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:11:56.268025 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0a4d50ce-e152-4727-be9d-e88fd08d47e7 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('3073c0dd-558d-441d-9baf-8372f45e944c',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:11:56.268521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0a4d50ce-e152-4727-be9d-e88fd08d47e7 admin admin] Resource SecurityGroupRule deleted: b235d275-0919-470e-ae5e-28257f1900e9 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:11:56.268906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-0a4d50ce-e152-4727-be9d-e88fd08d47e7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (b235d275-0919-470e-ae5e-28257f1900e9), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:56.269328 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-0a4d50ce-e152-4727-be9d-e88fd08d47e7 admin admin] Security group rule updated ['3073c0dd-558d-441d-9baf-8372f45e944c'] Sep 04 01:11:56.269692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0a4d50ce-e152-4727-be9d-e88fd08d47e7 admin admin] Resource SecurityGroupRule deleted: b50dd489-cf9d-49f4-b9db-9648b0b80027 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:11:56.270064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-0a4d50ce-e152-4727-be9d-e88fd08d47e7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (b50dd489-cf9d-49f4-b9db-9648b0b80027), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:56.270381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-0a4d50ce-e152-4727-be9d-e88fd08d47e7 admin admin] Security group rule updated ['3073c0dd-558d-441d-9baf-8372f45e944c'] Sep 04 01:11:56.270913 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0a4d50ce-e152-4727-be9d-e88fd08d47e7 admin admin] Resource SecurityGroupRule deleted: c81e6a00-3faf-40bf-981d-fa39e8dfe2c1 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:11:56.271251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-0a4d50ce-e152-4727-be9d-e88fd08d47e7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (c81e6a00-3faf-40bf-981d-fa39e8dfe2c1), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:56.271577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-0a4d50ce-e152-4727-be9d-e88fd08d47e7 admin admin] Security group rule updated ['3073c0dd-558d-441d-9baf-8372f45e944c'] Sep 04 01:11:56.272013 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0a4d50ce-e152-4727-be9d-e88fd08d47e7 admin admin] Resource SecurityGroupRule deleted: eba93b3b-53b1-49d3-abcc-362c7b9751ae {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:11:56.272588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-0a4d50ce-e152-4727-be9d-e88fd08d47e7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (eba93b3b-53b1-49d3-abcc-362c7b9751ae), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:56.272910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-0a4d50ce-e152-4727-be9d-e88fd08d47e7 admin admin] Security group rule updated ['3073c0dd-558d-441d-9baf-8372f45e944c'] Sep 04 01:11:56.462385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:453 started Sep 04 01:11:56.469806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade56c3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=857000000,duration_sec=925,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:11:56.469806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:11:56.469806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:453 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 04 01:11:57.079899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-66f5e9c0-77b9-4f30-bb5f-afab58a751a3 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:11:56Z,description='Default security group',id=0f8ffcd8-c37d-42e8-8f22-28ed96f1bd51,is_default=True,name='default',project_id='b8d506bb2b664efaab15c7efa82d40d9',revision_number=1,rules=[SecurityGroupRule(627b5d9c-1487-4022-bf0f-76ee13bf597b),SecurityGroupRule(74fa254a-ffbc-4b32-96a9-2b75e43e1779),SecurityGroupRule(893979a7-50cc-4b19-ac09-e2282c1b763e),SecurityGroupRule(aad0fb40-4af3-47aa-bed1-9ab7091b20d5)],shared=False,stateful=True,updated_at=2022-09-04T01:11:56Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:11:57.080507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-66f5e9c0-77b9-4f30-bb5f-afab58a751a3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (0f8ffcd8-c37d-42e8-8f22-28ed96f1bd51), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:57.080890 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-66f5e9c0-77b9-4f30-bb5f-afab58a751a3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:11:56Z,description=,direction='egress',ethertype='IPv6',id=627b5d9c-1487-4022-bf0f-76ee13bf597b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b8d506bb2b664efaab15c7efa82d40d9',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0f8ffcd8-c37d-42e8-8f22-28ed96f1bd51,updated_at=2022-09-04T01:11:56Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:11:57.081281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-66f5e9c0-77b9-4f30-bb5f-afab58a751a3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (627b5d9c-1487-4022-bf0f-76ee13bf597b), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:57.081746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-66f5e9c0-77b9-4f30-bb5f-afab58a751a3 admin admin] Security group rule updated ['0f8ffcd8-c37d-42e8-8f22-28ed96f1bd51'] Sep 04 01:11:57.082498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-66f5e9c0-77b9-4f30-bb5f-afab58a751a3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:11:56Z,description=,direction='ingress',ethertype='IPv4',id=74fa254a-ffbc-4b32-96a9-2b75e43e1779,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b8d506bb2b664efaab15c7efa82d40d9',protocol=,remote_address_group_id=,remote_group_id=0f8ffcd8-c37d-42e8-8f22-28ed96f1bd51,remote_ip_prefix=,revision_number=0,security_group_id=0f8ffcd8-c37d-42e8-8f22-28ed96f1bd51,updated_at=2022-09-04T01:11:56Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:11:57.082975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-66f5e9c0-77b9-4f30-bb5f-afab58a751a3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (74fa254a-ffbc-4b32-96a9-2b75e43e1779), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:57.083308 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-66f5e9c0-77b9-4f30-bb5f-afab58a751a3 admin admin] Security group rule updated ['0f8ffcd8-c37d-42e8-8f22-28ed96f1bd51'] Sep 04 01:11:57.084014 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-66f5e9c0-77b9-4f30-bb5f-afab58a751a3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:11:56Z,description=,direction='egress',ethertype='IPv4',id=893979a7-50cc-4b19-ac09-e2282c1b763e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b8d506bb2b664efaab15c7efa82d40d9',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0f8ffcd8-c37d-42e8-8f22-28ed96f1bd51,updated_at=2022-09-04T01:11:56Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:11:57.084367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-66f5e9c0-77b9-4f30-bb5f-afab58a751a3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (893979a7-50cc-4b19-ac09-e2282c1b763e), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:57.084695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-66f5e9c0-77b9-4f30-bb5f-afab58a751a3 admin admin] Security group rule updated ['0f8ffcd8-c37d-42e8-8f22-28ed96f1bd51'] Sep 04 01:11:57.085421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-66f5e9c0-77b9-4f30-bb5f-afab58a751a3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:11:56Z,description=,direction='ingress',ethertype='IPv6',id=aad0fb40-4af3-47aa-bed1-9ab7091b20d5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b8d506bb2b664efaab15c7efa82d40d9',protocol=,remote_address_group_id=,remote_group_id=0f8ffcd8-c37d-42e8-8f22-28ed96f1bd51,remote_ip_prefix=,revision_number=0,security_group_id=0f8ffcd8-c37d-42e8-8f22-28ed96f1bd51,updated_at=2022-09-04T01:11:56Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:11:57.088769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-66f5e9c0-77b9-4f30-bb5f-afab58a751a3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (aad0fb40-4af3-47aa-bed1-9ab7091b20d5), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:57.088769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-66f5e9c0-77b9-4f30-bb5f-afab58a751a3 admin admin] Security group rule updated ['0f8ffcd8-c37d-42e8-8f22-28ed96f1bd51'] Sep 04 01:11:57.382527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-545ad74e-2c53-4282-9006-a6c165527db7 admin admin] Resource SecurityGroup deleted: 0f8ffcd8-c37d-42e8-8f22-28ed96f1bd51 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:11:57.382967 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-545ad74e-2c53-4282-9006-a6c165527db7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (0f8ffcd8-c37d-42e8-8f22-28ed96f1bd51), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:57.383721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-545ad74e-2c53-4282-9006-a6c165527db7 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('0f8ffcd8-c37d-42e8-8f22-28ed96f1bd51',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:11:57.400826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-545ad74e-2c53-4282-9006-a6c165527db7 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('0f8ffcd8-c37d-42e8-8f22-28ed96f1bd51',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:11:57.401394 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-545ad74e-2c53-4282-9006-a6c165527db7 admin admin] Resource SecurityGroupRule deleted: 627b5d9c-1487-4022-bf0f-76ee13bf597b {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:11:57.401767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-545ad74e-2c53-4282-9006-a6c165527db7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (627b5d9c-1487-4022-bf0f-76ee13bf597b), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:57.402271 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-545ad74e-2c53-4282-9006-a6c165527db7 admin admin] Security group rule updated ['0f8ffcd8-c37d-42e8-8f22-28ed96f1bd51'] Sep 04 01:11:57.402710 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-545ad74e-2c53-4282-9006-a6c165527db7 admin admin] Resource SecurityGroupRule deleted: 74fa254a-ffbc-4b32-96a9-2b75e43e1779 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:11:57.403187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-545ad74e-2c53-4282-9006-a6c165527db7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (74fa254a-ffbc-4b32-96a9-2b75e43e1779), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:57.403508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-545ad74e-2c53-4282-9006-a6c165527db7 admin admin] Security group rule updated ['0f8ffcd8-c37d-42e8-8f22-28ed96f1bd51'] Sep 04 01:11:57.403922 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-545ad74e-2c53-4282-9006-a6c165527db7 admin admin] Resource SecurityGroupRule deleted: 893979a7-50cc-4b19-ac09-e2282c1b763e {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:11:57.404265 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-545ad74e-2c53-4282-9006-a6c165527db7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (893979a7-50cc-4b19-ac09-e2282c1b763e), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:57.404583 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-545ad74e-2c53-4282-9006-a6c165527db7 admin admin] Security group rule updated ['0f8ffcd8-c37d-42e8-8f22-28ed96f1bd51'] Sep 04 01:11:57.405002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-545ad74e-2c53-4282-9006-a6c165527db7 admin admin] Resource SecurityGroupRule deleted: aad0fb40-4af3-47aa-bed1-9ab7091b20d5 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:11:57.405479 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-545ad74e-2c53-4282-9006-a6c165527db7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (aad0fb40-4af3-47aa-bed1-9ab7091b20d5), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:11:57.405822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-545ad74e-2c53-4282-9006-a6c165527db7 admin admin] Security group rule updated ['0f8ffcd8-c37d-42e8-8f22-28ed96f1bd51'] Sep 04 01:11:58.463247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:454 started Sep 04 01:11:58.466651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade56c5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=858000000,duration_sec=927,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:11:58.469678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:11:58.469678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:454 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 04 01:12:00.005798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Resource Port 19f203f1-14db-4bb0-aaad-c8e57c75d249 updated (revision_number 8->9). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:12:00.006390 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (19f203f1-14db-4bb0-aaad-c8e57c75d249), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:00.464068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:455 started Sep 04 01:12:00.466441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade56c7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=858000000,duration_sec=929,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:12:00.467150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:12:00.467564 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:455 - starting polling. Elapsed:0.004 Sep 04 01:12:00.470127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:00.473559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:455 - port information retrieved. Elapsed:0.010 Sep 04 01:12:00.473905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:455 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Sep 04 01:12:01.819925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-1ec8222a-e9f4-408c-a446-0b29260c3bcb tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Resource Port deleted: 73f5bdf6-a4ae-435e-9050-14b4d54218f9 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:01.823594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-1ec8222a-e9f4-408c-a446-0b29260c3bcb tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (73f5bdf6-a4ae-435e-9050-14b4d54218f9), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:01.824627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-1ec8222a-e9f4-408c-a446-0b29260c3bcb tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Security group member updated {'e95ae1f3-3d5c-45bf-84ed-24f618128ba8'} Sep 04 01:12:01.983228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Resource Port 19f203f1-14db-4bb0-aaad-c8e57c75d249 updated (revision_number 9->10). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:12:01.983611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (19f203f1-14db-4bb0-aaad-c8e57c75d249), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:02.464838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:456 started Sep 04 01:12:02.468886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade56c9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=860000000,duration_sec=931,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:12:02.469691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:12:02.470260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:456 - starting polling. Elapsed:0.005 Sep 04 01:12:02.474010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:02.477686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 73f5bdf6-a4ae-435e-9050-14b4d54218f9 not present in bridge br-int Sep 04 01:12:02.484999 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] net_uuid None not managed by VLAN manager Sep 04 01:12:02.485325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for ['73f5bdf6-a4ae-435e-9050-14b4d54218f9'] Sep 04 01:12:02.485665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 73f5bdf6-a4ae-435e-9050-14b4d54218f9 is not handled by the firewall. {{(pid=107812) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 04 01:12:02.489278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:456 - port information retrieved. Elapsed:0.025 Sep 04 01:12:02.489561 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:456 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.025 Sep 04 01:12:04.465521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:457 started Sep 04 01:12:04.469268 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade56cb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=860000000,duration_sec=933,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:12:04.470083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:12:04.470534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:457 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 04 01:12:05.323730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-5ddcbafb-f329-4cbd-b371-5c4fe31662ec tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Resource SecurityGroup deleted: e95ae1f3-3d5c-45bf-84ed-24f618128ba8 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:05.324172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-5ddcbafb-f329-4cbd-b371-5c4fe31662ec tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (e95ae1f3-3d5c-45bf-84ed-24f618128ba8), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:05.324697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ddcbafb-f329-4cbd-b371-5c4fe31662ec tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('e95ae1f3-3d5c-45bf-84ed-24f618128ba8',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:12:05.339796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-5ddcbafb-f329-4cbd-b371-5c4fe31662ec tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('e95ae1f3-3d5c-45bf-84ed-24f618128ba8',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:12:05.340230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-5ddcbafb-f329-4cbd-b371-5c4fe31662ec tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Resource SecurityGroupRule deleted: 1550e5b3-cf24-4688-99b3-d39d477a5be2 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:05.340600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-5ddcbafb-f329-4cbd-b371-5c4fe31662ec tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (1550e5b3-cf24-4688-99b3-d39d477a5be2), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:05.340937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-5ddcbafb-f329-4cbd-b371-5c4fe31662ec tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Security group rule updated ['e95ae1f3-3d5c-45bf-84ed-24f618128ba8'] Sep 04 01:12:05.341420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-5ddcbafb-f329-4cbd-b371-5c4fe31662ec tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Resource SecurityGroupRule deleted: 7f62b640-5da1-4930-b3e2-240f0b785879 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:05.342569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-5ddcbafb-f329-4cbd-b371-5c4fe31662ec tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (7f62b640-5da1-4930-b3e2-240f0b785879), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:05.343054 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-5ddcbafb-f329-4cbd-b371-5c4fe31662ec tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Security group rule updated ['e95ae1f3-3d5c-45bf-84ed-24f618128ba8'] Sep 04 01:12:05.343487 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-5ddcbafb-f329-4cbd-b371-5c4fe31662ec tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Resource SecurityGroupRule deleted: 33f7440f-60fc-4ed4-8dcc-486d5a3b1294 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:05.343827 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-5ddcbafb-f329-4cbd-b371-5c4fe31662ec tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (33f7440f-60fc-4ed4-8dcc-486d5a3b1294), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:05.344147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-5ddcbafb-f329-4cbd-b371-5c4fe31662ec tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Security group rule updated ['e95ae1f3-3d5c-45bf-84ed-24f618128ba8'] Sep 04 01:12:05.345006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-5ddcbafb-f329-4cbd-b371-5c4fe31662ec tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Resource SecurityGroupRule deleted: dbffe037-a73b-4d02-a984-c2f52b240ae1 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:05.345390 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-5ddcbafb-f329-4cbd-b371-5c4fe31662ec tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (dbffe037-a73b-4d02-a984-c2f52b240ae1), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:05.349459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-5ddcbafb-f329-4cbd-b371-5c4fe31662ec tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Security group rule updated ['e95ae1f3-3d5c-45bf-84ed-24f618128ba8'] Sep 04 01:12:05.748746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-7c6ca59e-6b52-41a1-bbbe-472912ee527d tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Resource Port deleted: 7bd0ca2e-7896-4725-9c0d-a0da60cf0a30 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:05.749709 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-7c6ca59e-6b52-41a1-bbbe-472912ee527d tempest-AttachVolumeTestJSON-1676343226 tempest-AttachVolumeTestJSON-1676343226-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (7bd0ca2e-7896-4725-9c0d-a0da60cf0a30), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:06.466335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:458 started Sep 04 01:12:06.469685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade56cd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=861000000,duration_sec=935,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:12:06.470249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:12:06.470581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:458 - starting polling. Elapsed:0.004 Sep 04 01:12:06.473251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:06.475022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 7bd0ca2e-7896-4725-9c0d-a0da60cf0a30 not present in bridge br-int Sep 04 01:12:06.475351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] net_uuid None not managed by VLAN manager Sep 04 01:12:06.475696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for ['7bd0ca2e-7896-4725-9c0d-a0da60cf0a30'] Sep 04 01:12:06.476018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 7bd0ca2e-7896-4725-9c0d-a0da60cf0a30 is not handled by the firewall. {{(pid=107812) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 04 01:12:06.479400 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:458 - port information retrieved. Elapsed:0.013 Sep 04 01:12:06.479737 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:458 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.014 Sep 04 01:12:08.467032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:459 started Sep 04 01:12:08.470441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade56cf,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=861000000,duration_sec=937,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:12:08.471001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:12:08.471740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:459 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 04 01:12:09.205429 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-1ddb467d-e192-4cc9-8b2b-f8a2fac82078 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:12:09Z,description='Default security group',id=311f4d1f-cbf5-4f9c-a81e-aa6be9eb7d69,is_default=True,name='default',project_id='4a9de8cefc614e71b43a8ccead0d671a',revision_number=1,rules=[SecurityGroupRule(4bf28ad3-c80e-4271-9945-999fa1e6416a),SecurityGroupRule(e4fed7da-b116-425c-b464-39340ed3aba8),SecurityGroupRule(f34cb6eb-19df-4842-b73a-2d5cb3b100e4),SecurityGroupRule(f587b825-db3b-440a-96bc-8f96e4b0119b)],shared=False,stateful=True,updated_at=2022-09-04T01:12:09Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:09.205818 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-1ddb467d-e192-4cc9-8b2b-f8a2fac82078 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (311f4d1f-cbf5-4f9c-a81e-aa6be9eb7d69), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:09.206445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-1ddb467d-e192-4cc9-8b2b-f8a2fac82078 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:12:09Z,description=,direction='egress',ethertype='IPv6',id=4bf28ad3-c80e-4271-9945-999fa1e6416a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='4a9de8cefc614e71b43a8ccead0d671a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=311f4d1f-cbf5-4f9c-a81e-aa6be9eb7d69,updated_at=2022-09-04T01:12:09Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:09.206813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-1ddb467d-e192-4cc9-8b2b-f8a2fac82078 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (4bf28ad3-c80e-4271-9945-999fa1e6416a), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:09.207191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-1ddb467d-e192-4cc9-8b2b-f8a2fac82078 admin admin] Security group rule updated ['311f4d1f-cbf5-4f9c-a81e-aa6be9eb7d69'] Sep 04 01:12:09.207928 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-1ddb467d-e192-4cc9-8b2b-f8a2fac82078 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:12:09Z,description=,direction='ingress',ethertype='IPv4',id=e4fed7da-b116-425c-b464-39340ed3aba8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='4a9de8cefc614e71b43a8ccead0d671a',protocol=,remote_address_group_id=,remote_group_id=311f4d1f-cbf5-4f9c-a81e-aa6be9eb7d69,remote_ip_prefix=,revision_number=0,security_group_id=311f4d1f-cbf5-4f9c-a81e-aa6be9eb7d69,updated_at=2022-09-04T01:12:09Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:09.208285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-1ddb467d-e192-4cc9-8b2b-f8a2fac82078 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (e4fed7da-b116-425c-b464-39340ed3aba8), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:09.208618 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-1ddb467d-e192-4cc9-8b2b-f8a2fac82078 admin admin] Security group rule updated ['311f4d1f-cbf5-4f9c-a81e-aa6be9eb7d69'] Sep 04 01:12:09.209353 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-1ddb467d-e192-4cc9-8b2b-f8a2fac82078 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:12:09Z,description=,direction='egress',ethertype='IPv4',id=f34cb6eb-19df-4842-b73a-2d5cb3b100e4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='4a9de8cefc614e71b43a8ccead0d671a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=311f4d1f-cbf5-4f9c-a81e-aa6be9eb7d69,updated_at=2022-09-04T01:12:09Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:09.209712 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-1ddb467d-e192-4cc9-8b2b-f8a2fac82078 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (f34cb6eb-19df-4842-b73a-2d5cb3b100e4), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:09.222793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-1ddb467d-e192-4cc9-8b2b-f8a2fac82078 admin admin] Security group rule updated ['311f4d1f-cbf5-4f9c-a81e-aa6be9eb7d69'] Sep 04 01:12:09.222793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-1ddb467d-e192-4cc9-8b2b-f8a2fac82078 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:12:09Z,description=,direction='ingress',ethertype='IPv6',id=f587b825-db3b-440a-96bc-8f96e4b0119b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='4a9de8cefc614e71b43a8ccead0d671a',protocol=,remote_address_group_id=,remote_group_id=311f4d1f-cbf5-4f9c-a81e-aa6be9eb7d69,remote_ip_prefix=,revision_number=0,security_group_id=311f4d1f-cbf5-4f9c-a81e-aa6be9eb7d69,updated_at=2022-09-04T01:12:09Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:09.222793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-1ddb467d-e192-4cc9-8b2b-f8a2fac82078 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (f587b825-db3b-440a-96bc-8f96e4b0119b), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:09.222793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-1ddb467d-e192-4cc9-8b2b-f8a2fac82078 admin admin] Security group rule updated ['311f4d1f-cbf5-4f9c-a81e-aa6be9eb7d69'] Sep 04 01:12:09.478259 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-eb715d07-f0f8-4dc7-a36a-60704be8b8dd admin admin] Resource SecurityGroup deleted: 311f4d1f-cbf5-4f9c-a81e-aa6be9eb7d69 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:09.478858 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-eb715d07-f0f8-4dc7-a36a-60704be8b8dd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (311f4d1f-cbf5-4f9c-a81e-aa6be9eb7d69), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:09.479106 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb715d07-f0f8-4dc7-a36a-60704be8b8dd admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('311f4d1f-cbf5-4f9c-a81e-aa6be9eb7d69',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:12:09.494561 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-eb715d07-f0f8-4dc7-a36a-60704be8b8dd admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('311f4d1f-cbf5-4f9c-a81e-aa6be9eb7d69',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:12:09.495054 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-eb715d07-f0f8-4dc7-a36a-60704be8b8dd admin admin] Resource SecurityGroupRule deleted: 4bf28ad3-c80e-4271-9945-999fa1e6416a {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:09.495421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-eb715d07-f0f8-4dc7-a36a-60704be8b8dd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (4bf28ad3-c80e-4271-9945-999fa1e6416a), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:09.503676 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-eb715d07-f0f8-4dc7-a36a-60704be8b8dd admin admin] Security group rule updated ['311f4d1f-cbf5-4f9c-a81e-aa6be9eb7d69'] Sep 04 01:12:09.503676 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-eb715d07-f0f8-4dc7-a36a-60704be8b8dd admin admin] Resource SecurityGroupRule deleted: e4fed7da-b116-425c-b464-39340ed3aba8 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:09.503676 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-eb715d07-f0f8-4dc7-a36a-60704be8b8dd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (e4fed7da-b116-425c-b464-39340ed3aba8), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:09.503676 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-eb715d07-f0f8-4dc7-a36a-60704be8b8dd admin admin] Security group rule updated ['311f4d1f-cbf5-4f9c-a81e-aa6be9eb7d69'] Sep 04 01:12:09.503676 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-eb715d07-f0f8-4dc7-a36a-60704be8b8dd admin admin] Resource SecurityGroupRule deleted: f34cb6eb-19df-4842-b73a-2d5cb3b100e4 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:09.504283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-eb715d07-f0f8-4dc7-a36a-60704be8b8dd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (f34cb6eb-19df-4842-b73a-2d5cb3b100e4), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:09.504283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-eb715d07-f0f8-4dc7-a36a-60704be8b8dd admin admin] Security group rule updated ['311f4d1f-cbf5-4f9c-a81e-aa6be9eb7d69'] Sep 04 01:12:09.504283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-eb715d07-f0f8-4dc7-a36a-60704be8b8dd admin admin] Resource SecurityGroupRule deleted: f587b825-db3b-440a-96bc-8f96e4b0119b {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:09.504283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-eb715d07-f0f8-4dc7-a36a-60704be8b8dd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (f587b825-db3b-440a-96bc-8f96e4b0119b), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:09.504283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-eb715d07-f0f8-4dc7-a36a-60704be8b8dd admin admin] Security group rule updated ['311f4d1f-cbf5-4f9c-a81e-aa6be9eb7d69'] Sep 04 01:12:10.441472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-30abd4a0-d124-4ed7-ab8a-c0f711d31a03 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:12:10Z,description='Default security group',id=1e1d9496-d838-4cf4-a57b-9be043232d37,is_default=True,name='default',project_id='7b00179d801c40fd8d01bcb03cf3f14b',revision_number=1,rules=[SecurityGroupRule(0ed5fb94-63e3-494a-8d16-066a63eb136c),SecurityGroupRule(7986e67c-06fb-45dc-b2ad-e19b9125f961),SecurityGroupRule(bf99007e-0bb0-4f21-b40d-d20bdae4c50d),SecurityGroupRule(e33e4bbb-1c07-4bfa-9996-19053f789517)],shared=False,stateful=True,updated_at=2022-09-04T01:12:10Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:10.442442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-30abd4a0-d124-4ed7-ab8a-c0f711d31a03 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (1e1d9496-d838-4cf4-a57b-9be043232d37), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:10.443360 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-30abd4a0-d124-4ed7-ab8a-c0f711d31a03 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:12:10Z,description=,direction='egress',ethertype='IPv6',id=0ed5fb94-63e3-494a-8d16-066a63eb136c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7b00179d801c40fd8d01bcb03cf3f14b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=1e1d9496-d838-4cf4-a57b-9be043232d37,updated_at=2022-09-04T01:12:10Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:10.443787 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-30abd4a0-d124-4ed7-ab8a-c0f711d31a03 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (0ed5fb94-63e3-494a-8d16-066a63eb136c), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:10.444335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-30abd4a0-d124-4ed7-ab8a-c0f711d31a03 admin admin] Security group rule updated ['1e1d9496-d838-4cf4-a57b-9be043232d37'] Sep 04 01:12:10.445302 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-30abd4a0-d124-4ed7-ab8a-c0f711d31a03 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:12:10Z,description=,direction='ingress',ethertype='IPv4',id=7986e67c-06fb-45dc-b2ad-e19b9125f961,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7b00179d801c40fd8d01bcb03cf3f14b',protocol=,remote_address_group_id=,remote_group_id=1e1d9496-d838-4cf4-a57b-9be043232d37,remote_ip_prefix=,revision_number=0,security_group_id=1e1d9496-d838-4cf4-a57b-9be043232d37,updated_at=2022-09-04T01:12:10Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:10.446370 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-30abd4a0-d124-4ed7-ab8a-c0f711d31a03 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (7986e67c-06fb-45dc-b2ad-e19b9125f961), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:10.446370 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-30abd4a0-d124-4ed7-ab8a-c0f711d31a03 admin admin] Security group rule updated ['1e1d9496-d838-4cf4-a57b-9be043232d37'] Sep 04 01:12:10.447417 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-30abd4a0-d124-4ed7-ab8a-c0f711d31a03 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:12:10Z,description=,direction='ingress',ethertype='IPv6',id=bf99007e-0bb0-4f21-b40d-d20bdae4c50d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7b00179d801c40fd8d01bcb03cf3f14b',protocol=,remote_address_group_id=,remote_group_id=1e1d9496-d838-4cf4-a57b-9be043232d37,remote_ip_prefix=,revision_number=0,security_group_id=1e1d9496-d838-4cf4-a57b-9be043232d37,updated_at=2022-09-04T01:12:10Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:10.448223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-30abd4a0-d124-4ed7-ab8a-c0f711d31a03 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (bf99007e-0bb0-4f21-b40d-d20bdae4c50d), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:10.448845 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-30abd4a0-d124-4ed7-ab8a-c0f711d31a03 admin admin] Security group rule updated ['1e1d9496-d838-4cf4-a57b-9be043232d37'] Sep 04 01:12:10.449588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-30abd4a0-d124-4ed7-ab8a-c0f711d31a03 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:12:10Z,description=,direction='egress',ethertype='IPv4',id=e33e4bbb-1c07-4bfa-9996-19053f789517,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7b00179d801c40fd8d01bcb03cf3f14b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=1e1d9496-d838-4cf4-a57b-9be043232d37,updated_at=2022-09-04T01:12:10Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:10.450164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-30abd4a0-d124-4ed7-ab8a-c0f711d31a03 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (e33e4bbb-1c07-4bfa-9996-19053f789517), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:10.450749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-30abd4a0-d124-4ed7-ab8a-c0f711d31a03 admin admin] Security group rule updated ['1e1d9496-d838-4cf4-a57b-9be043232d37'] Sep 04 01:12:10.467588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:460 started Sep 04 01:12:10.471315 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade56d1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=862000000,duration_sec=939,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:12:10.472153 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:12:10.472511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:460 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 04 01:12:10.668757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-09a1421e-276b-468b-a4d9-a3aa3a425553 admin admin] Resource SecurityGroup deleted: 1e1d9496-d838-4cf4-a57b-9be043232d37 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:10.669439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-09a1421e-276b-468b-a4d9-a3aa3a425553 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (1e1d9496-d838-4cf4-a57b-9be043232d37), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:10.669602 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09a1421e-276b-468b-a4d9-a3aa3a425553 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('1e1d9496-d838-4cf4-a57b-9be043232d37',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:12:10.688022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-09a1421e-276b-468b-a4d9-a3aa3a425553 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('1e1d9496-d838-4cf4-a57b-9be043232d37',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:12:10.691840 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-09a1421e-276b-468b-a4d9-a3aa3a425553 admin admin] Resource SecurityGroupRule deleted: 0ed5fb94-63e3-494a-8d16-066a63eb136c {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:10.691840 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-09a1421e-276b-468b-a4d9-a3aa3a425553 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (0ed5fb94-63e3-494a-8d16-066a63eb136c), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:10.691840 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-09a1421e-276b-468b-a4d9-a3aa3a425553 admin admin] Security group rule updated ['1e1d9496-d838-4cf4-a57b-9be043232d37'] Sep 04 01:12:10.691840 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-09a1421e-276b-468b-a4d9-a3aa3a425553 admin admin] Resource SecurityGroupRule deleted: 7986e67c-06fb-45dc-b2ad-e19b9125f961 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:10.691840 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-09a1421e-276b-468b-a4d9-a3aa3a425553 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (7986e67c-06fb-45dc-b2ad-e19b9125f961), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:10.692272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-09a1421e-276b-468b-a4d9-a3aa3a425553 admin admin] Security group rule updated ['1e1d9496-d838-4cf4-a57b-9be043232d37'] Sep 04 01:12:10.692272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-09a1421e-276b-468b-a4d9-a3aa3a425553 admin admin] Resource SecurityGroupRule deleted: bf99007e-0bb0-4f21-b40d-d20bdae4c50d {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:10.692272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-09a1421e-276b-468b-a4d9-a3aa3a425553 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (bf99007e-0bb0-4f21-b40d-d20bdae4c50d), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:10.692272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-09a1421e-276b-468b-a4d9-a3aa3a425553 admin admin] Security group rule updated ['1e1d9496-d838-4cf4-a57b-9be043232d37'] Sep 04 01:12:10.693512 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-09a1421e-276b-468b-a4d9-a3aa3a425553 admin admin] Resource SecurityGroupRule deleted: e33e4bbb-1c07-4bfa-9996-19053f789517 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:10.693872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-09a1421e-276b-468b-a4d9-a3aa3a425553 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (e33e4bbb-1c07-4bfa-9996-19053f789517), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:10.694404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-09a1421e-276b-468b-a4d9-a3aa3a425553 admin admin] Security group rule updated ['1e1d9496-d838-4cf4-a57b-9be043232d37'] Sep 04 01:12:11.337486 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-992bf5a7-f22e-4eb9-9542-1a943477e98b admin admin] Resource Port deleted: 378bbdd4-3077-4657-8055-fdc0a7600948 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:11.338472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-992bf5a7-f22e-4eb9-9542-1a943477e98b admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (378bbdd4-3077-4657-8055-fdc0a7600948), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:11.682991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c78a7060-941d-4519-98ac-88f0203ccc53 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:12:11Z,description='Default security group',id=83b8e58e-2e84-4bb3-87ab-7e4701d90a69,is_default=True,name='default',project_id='b8b43148935f46118bf416336b1abdbe',revision_number=1,rules=[SecurityGroupRule(09794599-811a-4ff0-bc18-949d368415dd),SecurityGroupRule(41ba7180-4b06-4d29-8433-93db794dbf7c),SecurityGroupRule(557d3f93-b18c-478e-bd6c-57025cc4cc34),SecurityGroupRule(8334a4c4-cdaf-46de-9058-a084db6a0091)],shared=False,stateful=True,updated_at=2022-09-04T01:12:11Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:11.682991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-c78a7060-941d-4519-98ac-88f0203ccc53 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (83b8e58e-2e84-4bb3-87ab-7e4701d90a69), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:11.682991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c78a7060-941d-4519-98ac-88f0203ccc53 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:12:11Z,description=,direction='egress',ethertype='IPv6',id=09794599-811a-4ff0-bc18-949d368415dd,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b8b43148935f46118bf416336b1abdbe',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=83b8e58e-2e84-4bb3-87ab-7e4701d90a69,updated_at=2022-09-04T01:12:11Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:11.683738 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-c78a7060-941d-4519-98ac-88f0203ccc53 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (09794599-811a-4ff0-bc18-949d368415dd), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:11.683738 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-c78a7060-941d-4519-98ac-88f0203ccc53 admin admin] Security group rule updated ['83b8e58e-2e84-4bb3-87ab-7e4701d90a69'] Sep 04 01:12:11.684420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c78a7060-941d-4519-98ac-88f0203ccc53 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:12:11Z,description=,direction='ingress',ethertype='IPv4',id=41ba7180-4b06-4d29-8433-93db794dbf7c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b8b43148935f46118bf416336b1abdbe',protocol=,remote_address_group_id=,remote_group_id=83b8e58e-2e84-4bb3-87ab-7e4701d90a69,remote_ip_prefix=,revision_number=0,security_group_id=83b8e58e-2e84-4bb3-87ab-7e4701d90a69,updated_at=2022-09-04T01:12:11Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:11.684779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-c78a7060-941d-4519-98ac-88f0203ccc53 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (41ba7180-4b06-4d29-8433-93db794dbf7c), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:11.685334 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-c78a7060-941d-4519-98ac-88f0203ccc53 admin admin] Security group rule updated ['83b8e58e-2e84-4bb3-87ab-7e4701d90a69'] Sep 04 01:12:11.686295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c78a7060-941d-4519-98ac-88f0203ccc53 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:12:11Z,description=,direction='ingress',ethertype='IPv6',id=557d3f93-b18c-478e-bd6c-57025cc4cc34,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b8b43148935f46118bf416336b1abdbe',protocol=,remote_address_group_id=,remote_group_id=83b8e58e-2e84-4bb3-87ab-7e4701d90a69,remote_ip_prefix=,revision_number=0,security_group_id=83b8e58e-2e84-4bb3-87ab-7e4701d90a69,updated_at=2022-09-04T01:12:11Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:11.686917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-c78a7060-941d-4519-98ac-88f0203ccc53 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (557d3f93-b18c-478e-bd6c-57025cc4cc34), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:11.687960 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-c78a7060-941d-4519-98ac-88f0203ccc53 admin admin] Security group rule updated ['83b8e58e-2e84-4bb3-87ab-7e4701d90a69'] Sep 04 01:12:11.688816 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c78a7060-941d-4519-98ac-88f0203ccc53 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:12:11Z,description=,direction='egress',ethertype='IPv4',id=8334a4c4-cdaf-46de-9058-a084db6a0091,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b8b43148935f46118bf416336b1abdbe',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=83b8e58e-2e84-4bb3-87ab-7e4701d90a69,updated_at=2022-09-04T01:12:11Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:11.689192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-c78a7060-941d-4519-98ac-88f0203ccc53 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (8334a4c4-cdaf-46de-9058-a084db6a0091), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:11.689684 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-c78a7060-941d-4519-98ac-88f0203ccc53 admin admin] Security group rule updated ['83b8e58e-2e84-4bb3-87ab-7e4701d90a69'] Sep 04 01:12:12.176519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-3e551408-f71c-48c9-8110-28630a4c1516 admin admin] Resource SecurityGroup deleted: 83b8e58e-2e84-4bb3-87ab-7e4701d90a69 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:12.177052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-3e551408-f71c-48c9-8110-28630a4c1516 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (83b8e58e-2e84-4bb3-87ab-7e4701d90a69), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:12.177580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e551408-f71c-48c9-8110-28630a4c1516 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('83b8e58e-2e84-4bb3-87ab-7e4701d90a69',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:12:12.209980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-3e551408-f71c-48c9-8110-28630a4c1516 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('83b8e58e-2e84-4bb3-87ab-7e4701d90a69',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:12:12.212538 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-3e551408-f71c-48c9-8110-28630a4c1516 admin admin] Resource SecurityGroupRule deleted: 09794599-811a-4ff0-bc18-949d368415dd {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:12.212925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-3e551408-f71c-48c9-8110-28630a4c1516 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (09794599-811a-4ff0-bc18-949d368415dd), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:12.213346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-3e551408-f71c-48c9-8110-28630a4c1516 admin admin] Security group rule updated ['83b8e58e-2e84-4bb3-87ab-7e4701d90a69'] Sep 04 01:12:12.215417 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-3e551408-f71c-48c9-8110-28630a4c1516 admin admin] Resource SecurityGroupRule deleted: 41ba7180-4b06-4d29-8433-93db794dbf7c {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:12.216332 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-3e551408-f71c-48c9-8110-28630a4c1516 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (41ba7180-4b06-4d29-8433-93db794dbf7c), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:12.216673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-3e551408-f71c-48c9-8110-28630a4c1516 admin admin] Security group rule updated ['83b8e58e-2e84-4bb3-87ab-7e4701d90a69'] Sep 04 01:12:12.217745 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-3e551408-f71c-48c9-8110-28630a4c1516 admin admin] Resource SecurityGroupRule deleted: 557d3f93-b18c-478e-bd6c-57025cc4cc34 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:12.218161 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-3e551408-f71c-48c9-8110-28630a4c1516 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (557d3f93-b18c-478e-bd6c-57025cc4cc34), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:12.219007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-3e551408-f71c-48c9-8110-28630a4c1516 admin admin] Security group rule updated ['83b8e58e-2e84-4bb3-87ab-7e4701d90a69'] Sep 04 01:12:12.219666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-3e551408-f71c-48c9-8110-28630a4c1516 admin admin] Resource SecurityGroupRule deleted: 8334a4c4-cdaf-46de-9058-a084db6a0091 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:12.220181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-3e551408-f71c-48c9-8110-28630a4c1516 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (8334a4c4-cdaf-46de-9058-a084db6a0091), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:12.243835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-3e551408-f71c-48c9-8110-28630a4c1516 admin admin] Security group rule updated ['83b8e58e-2e84-4bb3-87ab-7e4701d90a69'] Sep 04 01:12:12.469249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:461 started Sep 04 01:12:12.471848 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade56d3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=863000000,duration_sec=941,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:12:12.472692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:12:12.473117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:461 - starting polling. Elapsed:0.005 Sep 04 01:12:12.476112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:12.480100 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-378bbdd4-30, col_values=(('tag', 4095),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:12:12.497525 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade56d5,OFPFlowMod(buffer_id=4294967295,command=0,cookie=6887031442322345889,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 19}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:12:12.498211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for ['378bbdd4-3077-4657-8055-fdc0a7600948'] Sep 04 01:12:12.498684 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 4 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:12:12.556648 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5503443-a738-427f-b435-6b56f473d8a7]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:12:12.560529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:461 - port information retrieved. Elapsed:0.092 Sep 04 01:12:12.560870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:461 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.093 Sep 04 01:12:12.868407 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["c4cde41c-c347-4cfb-9a6d-f1918d5c9489","delete","qr-378bbdd4-30",19,["map",[["attached-mac","fa:16:3e:0e:91:eb"],["iface-id","378bbdd4-3077-4657-8055-fdc0a7600948"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:12:12.963495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-7d57278e-59f2-42c4-a2ba-b4adbbd10e0d admin admin] Resource Port deleted: 3045b911-01c5-4fc3-8e89-ac2d9cea12a8 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:12.964531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-7d57278e-59f2-42c4-a2ba-b4adbbd10e0d admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (3045b911-01c5-4fc3-8e89-ac2d9cea12a8), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:13.295538 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["8bc3b20d-d676-4582-96f8-124edc43439f","delete","qg-3045b911-01",14,["map",[["attached-mac","fa:16:3e:f1:55:69"],["iface-id","3045b911-01c5-4fc3-8e89-ac2d9cea12a8"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:12:13.693387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-ca0934c3-9535-4dd0-bb70-28e2982fd99f admin admin] Resource Subnet deleted: cf87fd90-4193-4f02-8ccd-ce8ccea66ca5 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:13.693765 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-ca0934c3-9535-4dd0-bb70-28e2982fd99f admin admin] Publish callbacks [] for Subnet (cf87fd90-4193-4f02-8ccd-ce8ccea66ca5), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:13.888988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["e654db50-2184-4ae5-84eb-fd002a965d61","delete","tapdd44c60a-dd",9,["map",[["attached-mac","fa:16:3e:6f:ff:ef"],["iface-id","dd44c60a-dd0f-4ff2-85ae-8c012af89cf9"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:12:14.116629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Resource Port d072bfcf-41bd-430e-800c-1d1a3b17d915 updated (revision_number 5->6). Old fields: {'status': 'ACTIVE'} New fields: {'status': 'DOWN'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:12:14.117132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (d072bfcf-41bd-430e-800c-1d1a3b17d915), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:14.262810 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-ee766b5c-e238-4d63-b2c0-7303a2645acd admin admin] Resource Port deleted: dd44c60a-dd0f-4ff2-85ae-8c012af89cf9 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:14.263188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-ee766b5c-e238-4d63-b2c0-7303a2645acd admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (dd44c60a-dd0f-4ff2-85ae-8c012af89cf9), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:14.301330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-1613effb-8037-4963-8329-b3facfde648e None None] Resource Port deleted: dd44c60a-dd0f-4ff2-85ae-8c012af89cf9 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:14.305820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-1613effb-8037-4963-8329-b3facfde648e None None] Skipped duplicate delete event for dd44c60a-dd0f-4ff2-85ae-8c012af89cf9 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:209}} Sep 04 01:12:14.469526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:462 started Sep 04 01:12:14.472299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade56d7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=864000000,duration_sec=943,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:12:14.473277 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:12:14.473921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:462 - starting polling. Elapsed:0.005 Sep 04 01:12:14.476374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:14.482767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade56d9,OFPFlowMod(buffer_id=4294967295,command=3,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 9}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:12:14.486249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade56db,OFPFlowMod(buffer_id=4294967295,command=3,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 19}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:12:14.488872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade56dd,OFPFlowMod(buffer_id=4294967295,command=3,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 14}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:12:14.489414 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:462 - port information retrieved. Elapsed:0.020 Sep 04 01:12:14.489897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Starting to process devices in:{'current': {'c2f724af-5dbd-4d91-83cd-c5152b744599', 'da545e71-9e15-495e-b08a-2c36ede84742', 'a6788698-0516-4d8a-8fe8-2add6e7f6e94', '9db3ca9e-27d3-4852-b8c6-3fc745d2d055', '3fa24970-97a7-4f46-ac55-0b24323fa402', '0a1a9f7e-73de-4620-ae03-4b1d50d7f706', '89aa06b4-bbf1-40c2-bb48-500c3aecdf48', '68e4df44-e581-4fa1-922b-1b78021d5d7b', 'e507db86-47c3-4953-96bb-c5e552b4f602', '4ed942cd-0f45-4d77-a66d-1d6c875877dc', '53e7a39c-e9ce-45c4-84af-632f2aac70ae', '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', 'b4f93563-ff7a-44c4-96a1-87f6e4348648', 'f0af75e4-63aa-44d3-bff7-973c3caf9bf9', '1cf499fb-10a0-4af2-afec-5f610dc85da6', 'ca102ce7-433c-4029-aabf-33d944165ff1'}, 'added': set(), 'removed': {'dd44c60a-dd0f-4ff2-85ae-8c012af89cf9', '378bbdd4-3077-4657-8055-fdc0a7600948', '3045b911-01c5-4fc3-8e89-ac2d9cea12a8'}, 'updated': set(), 're_added': set()} {{(pid=107812) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 04 01:12:14.490384 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:462 - agent port security group processed in 0.000 Sep 04 01:12:14.494123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Configuration for devices up [] and devices down [] completed. Sep 04 01:12:14.494702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for {'dd44c60a-dd0f-4ff2-85ae-8c012af89cf9', '378bbdd4-3077-4657-8055-fdc0a7600948', '3045b911-01c5-4fc3-8e89-ac2d9cea12a8'} Sep 04 01:12:14.495244 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 378bbdd4-3077-4657-8055-fdc0a7600948 is not handled by the firewall. {{(pid=107812) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 04 01:12:14.495996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 8 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:12:14.565195 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9b73d2-9214-4b61-bec4-7b06d3383136]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:12:14.565983 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Ports {'dd44c60a-dd0f-4ff2-85ae-8c012af89cf9', '378bbdd4-3077-4657-8055-fdc0a7600948', '3045b911-01c5-4fc3-8e89-ac2d9cea12a8'} removed Sep 04 01:12:14.655288 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port removal failed for set() {{(pid=107812) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 04 01:12:14.659853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Reclaiming vlan = 8 from net-id = 1fb5aed8-696d-4f87-8b2a-7d29744538a8, seg-id = 193 Sep 04 01:12:14.660111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x1fd38c05,OFPFlowMod(buffer_id=4294967295,command=3,cookie=6561907047025962751,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4104}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:12:14.662734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xeade56df,OFPFlowMod(buffer_id=4294967295,command=3,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4289}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:12:14.663225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] net_uuid None not managed by VLAN manager Sep 04 01:12:14.664605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:462 - treat_devices_removed completed in 0.169 Sep 04 01:12:14.664886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:462 - ports processed. Elapsed:0.196 Sep 04 01:12:14.665252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:462 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 3}}. Elapsed:0.196 Sep 04 01:12:14.724714 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-ee766b5c-e238-4d63-b2c0-7303a2645acd admin admin] Resource Network deleted: 1fb5aed8-696d-4f87-8b2a-7d29744538a8 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:14.725263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-ee766b5c-e238-4d63-b2c0-7303a2645acd admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533'] for Network (1fb5aed8-696d-4f87-8b2a-7d29744538a8), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:15.402317 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b285a90e-cd35-43d5-9927-b6316ee9bb97 admin admin] Resource SecurityGroup deleted: 012b1c46-d5d0-4a92-9c0b-abcec93f605b {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:15.403541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b285a90e-cd35-43d5-9927-b6316ee9bb97 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (012b1c46-d5d0-4a92-9c0b-abcec93f605b), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:15.404340 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b285a90e-cd35-43d5-9927-b6316ee9bb97 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('012b1c46-d5d0-4a92-9c0b-abcec93f605b',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:12:15.423558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b285a90e-cd35-43d5-9927-b6316ee9bb97 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('012b1c46-d5d0-4a92-9c0b-abcec93f605b',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:12:15.429449 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b285a90e-cd35-43d5-9927-b6316ee9bb97 admin admin] Resource SecurityGroupRule deleted: 28d523e4-89f2-433c-8d56-58320374e80b {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:15.429944 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b285a90e-cd35-43d5-9927-b6316ee9bb97 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (28d523e4-89f2-433c-8d56-58320374e80b), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:15.430584 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-b285a90e-cd35-43d5-9927-b6316ee9bb97 admin admin] Security group rule updated ['012b1c46-d5d0-4a92-9c0b-abcec93f605b'] Sep 04 01:12:15.431044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b285a90e-cd35-43d5-9927-b6316ee9bb97 admin admin] Resource SecurityGroupRule deleted: 5123bd42-1cda-41c8-9a39-91e030680699 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:15.431395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b285a90e-cd35-43d5-9927-b6316ee9bb97 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (5123bd42-1cda-41c8-9a39-91e030680699), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:15.431718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-b285a90e-cd35-43d5-9927-b6316ee9bb97 admin admin] Security group rule updated ['012b1c46-d5d0-4a92-9c0b-abcec93f605b'] Sep 04 01:12:15.432140 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b285a90e-cd35-43d5-9927-b6316ee9bb97 admin admin] Resource SecurityGroupRule deleted: 859006e7-dbdd-44dd-837a-a89ace669c03 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:15.436548 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b285a90e-cd35-43d5-9927-b6316ee9bb97 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (859006e7-dbdd-44dd-837a-a89ace669c03), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:15.437630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-b285a90e-cd35-43d5-9927-b6316ee9bb97 admin admin] Security group rule updated ['012b1c46-d5d0-4a92-9c0b-abcec93f605b'] Sep 04 01:12:15.438096 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b285a90e-cd35-43d5-9927-b6316ee9bb97 admin admin] Resource SecurityGroupRule deleted: c2e404ef-9d8c-4552-992f-c7d111af9790 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:15.438469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b285a90e-cd35-43d5-9927-b6316ee9bb97 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (c2e404ef-9d8c-4552-992f-c7d111af9790), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:15.438790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-b285a90e-cd35-43d5-9927-b6316ee9bb97 admin admin] Security group rule updated ['012b1c46-d5d0-4a92-9c0b-abcec93f605b'] Sep 04 01:12:16.470650 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:463 started Sep 04 01:12:16.473995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade56e1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=865000000,duration_sec=945,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:12:16.474579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:12:16.474926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:463 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:12:17.798522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-258ffda8-13fa-4e4f-86d0-70a34a3a1b11 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:12:17Z,description='Default security group',id=07c6d8d7-f4cd-4ddf-960a-670a0cbdd2cb,is_default=True,name='default',project_id='6cfa564295f4423ead002277f3c4b3c2',revision_number=1,rules=[SecurityGroupRule(19ffac5a-ea91-4746-ab5b-02f6f860bf6e),SecurityGroupRule(9e58b52a-5ef0-4d44-9be4-dca931184857),SecurityGroupRule(ba6d0320-6681-4560-84d3-27e00daf24d6),SecurityGroupRule(c985254b-feba-492f-aa99-10786dd75e36)],shared=False,stateful=True,updated_at=2022-09-04T01:12:17Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:17.799223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-258ffda8-13fa-4e4f-86d0-70a34a3a1b11 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (07c6d8d7-f4cd-4ddf-960a-670a0cbdd2cb), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:17.799645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-258ffda8-13fa-4e4f-86d0-70a34a3a1b11 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:12:17Z,description=,direction='egress',ethertype='IPv4',id=19ffac5a-ea91-4746-ab5b-02f6f860bf6e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='6cfa564295f4423ead002277f3c4b3c2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=07c6d8d7-f4cd-4ddf-960a-670a0cbdd2cb,updated_at=2022-09-04T01:12:17Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:17.800009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-258ffda8-13fa-4e4f-86d0-70a34a3a1b11 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (19ffac5a-ea91-4746-ab5b-02f6f860bf6e), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:17.800353 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-258ffda8-13fa-4e4f-86d0-70a34a3a1b11 admin admin] Security group rule updated ['07c6d8d7-f4cd-4ddf-960a-670a0cbdd2cb'] Sep 04 01:12:17.801098 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-258ffda8-13fa-4e4f-86d0-70a34a3a1b11 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:12:17Z,description=,direction='ingress',ethertype='IPv6',id=9e58b52a-5ef0-4d44-9be4-dca931184857,normalized_cidr=None,port_range_max=,port_range_min=,project_id='6cfa564295f4423ead002277f3c4b3c2',protocol=,remote_address_group_id=,remote_group_id=07c6d8d7-f4cd-4ddf-960a-670a0cbdd2cb,remote_ip_prefix=,revision_number=0,security_group_id=07c6d8d7-f4cd-4ddf-960a-670a0cbdd2cb,updated_at=2022-09-04T01:12:17Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:17.801459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-258ffda8-13fa-4e4f-86d0-70a34a3a1b11 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (9e58b52a-5ef0-4d44-9be4-dca931184857), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:17.801792 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-258ffda8-13fa-4e4f-86d0-70a34a3a1b11 admin admin] Security group rule updated ['07c6d8d7-f4cd-4ddf-960a-670a0cbdd2cb'] Sep 04 01:12:17.802495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-258ffda8-13fa-4e4f-86d0-70a34a3a1b11 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:12:17Z,description=,direction='ingress',ethertype='IPv4',id=ba6d0320-6681-4560-84d3-27e00daf24d6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='6cfa564295f4423ead002277f3c4b3c2',protocol=,remote_address_group_id=,remote_group_id=07c6d8d7-f4cd-4ddf-960a-670a0cbdd2cb,remote_ip_prefix=,revision_number=0,security_group_id=07c6d8d7-f4cd-4ddf-960a-670a0cbdd2cb,updated_at=2022-09-04T01:12:17Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:17.803512 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-258ffda8-13fa-4e4f-86d0-70a34a3a1b11 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (ba6d0320-6681-4560-84d3-27e00daf24d6), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:17.803512 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-258ffda8-13fa-4e4f-86d0-70a34a3a1b11 admin admin] Security group rule updated ['07c6d8d7-f4cd-4ddf-960a-670a0cbdd2cb'] Sep 04 01:12:17.803857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-258ffda8-13fa-4e4f-86d0-70a34a3a1b11 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:12:17Z,description=,direction='egress',ethertype='IPv6',id=c985254b-feba-492f-aa99-10786dd75e36,normalized_cidr=None,port_range_max=,port_range_min=,project_id='6cfa564295f4423ead002277f3c4b3c2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=07c6d8d7-f4cd-4ddf-960a-670a0cbdd2cb,updated_at=2022-09-04T01:12:17Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:17.804212 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-258ffda8-13fa-4e4f-86d0-70a34a3a1b11 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (c985254b-feba-492f-aa99-10786dd75e36), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:17.804537 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-258ffda8-13fa-4e4f-86d0-70a34a3a1b11 admin admin] Security group rule updated ['07c6d8d7-f4cd-4ddf-960a-670a0cbdd2cb'] Sep 04 01:12:18.028873 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0e9c31a6-d141-4ec2-baa4-a56afa765c40 admin admin] Resource SecurityGroup deleted: 07c6d8d7-f4cd-4ddf-960a-670a0cbdd2cb {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:18.029538 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-0e9c31a6-d141-4ec2-baa4-a56afa765c40 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (07c6d8d7-f4cd-4ddf-960a-670a0cbdd2cb), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:18.030097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e9c31a6-d141-4ec2-baa4-a56afa765c40 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('07c6d8d7-f4cd-4ddf-960a-670a0cbdd2cb',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:12:18.043674 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0e9c31a6-d141-4ec2-baa4-a56afa765c40 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('07c6d8d7-f4cd-4ddf-960a-670a0cbdd2cb',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:12:18.045102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0e9c31a6-d141-4ec2-baa4-a56afa765c40 admin admin] Resource SecurityGroupRule deleted: 19ffac5a-ea91-4746-ab5b-02f6f860bf6e {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:18.045680 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-0e9c31a6-d141-4ec2-baa4-a56afa765c40 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (19ffac5a-ea91-4746-ab5b-02f6f860bf6e), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:18.050362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-0e9c31a6-d141-4ec2-baa4-a56afa765c40 admin admin] Security group rule updated ['07c6d8d7-f4cd-4ddf-960a-670a0cbdd2cb'] Sep 04 01:12:18.050362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0e9c31a6-d141-4ec2-baa4-a56afa765c40 admin admin] Resource SecurityGroupRule deleted: 9e58b52a-5ef0-4d44-9be4-dca931184857 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:18.050362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-0e9c31a6-d141-4ec2-baa4-a56afa765c40 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (9e58b52a-5ef0-4d44-9be4-dca931184857), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:18.050362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-0e9c31a6-d141-4ec2-baa4-a56afa765c40 admin admin] Security group rule updated ['07c6d8d7-f4cd-4ddf-960a-670a0cbdd2cb'] Sep 04 01:12:18.050362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0e9c31a6-d141-4ec2-baa4-a56afa765c40 admin admin] Resource SecurityGroupRule deleted: ba6d0320-6681-4560-84d3-27e00daf24d6 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:18.051041 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-0e9c31a6-d141-4ec2-baa4-a56afa765c40 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (ba6d0320-6681-4560-84d3-27e00daf24d6), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:18.051041 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-0e9c31a6-d141-4ec2-baa4-a56afa765c40 admin admin] Security group rule updated ['07c6d8d7-f4cd-4ddf-960a-670a0cbdd2cb'] Sep 04 01:12:18.051041 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0e9c31a6-d141-4ec2-baa4-a56afa765c40 admin admin] Resource SecurityGroupRule deleted: c985254b-feba-492f-aa99-10786dd75e36 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:18.051276 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-0e9c31a6-d141-4ec2-baa4-a56afa765c40 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (c985254b-feba-492f-aa99-10786dd75e36), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:18.051559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-0e9c31a6-d141-4ec2-baa4-a56afa765c40 admin admin] Security group rule updated ['07c6d8d7-f4cd-4ddf-960a-670a0cbdd2cb'] Sep 04 01:12:18.471609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:464 started Sep 04 01:12:18.474919 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade56e3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=866000000,duration_sec=947,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:12:18.475611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:12:18.476072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:464 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 04 01:12:18.613646 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0d91435c-58a4-4ed7-89a7-aad63f16c05a admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:12:18Z,description='Default security group',id=823d270d-d081-4de7-bd25-a956697a6925,is_default=True,name='default',project_id='5c147b2ed0724f149841d070b16f749d',revision_number=1,rules=[SecurityGroupRule(8738aa26-6f3f-4a3e-946a-87b085f299dd),SecurityGroupRule(a1ebe903-1d64-453f-b856-4ca5306c46f4),SecurityGroupRule(d58bd2cd-2732-4911-bf47-b756d18f7f7e),SecurityGroupRule(da14d2c0-75fe-4069-a22d-ed2c2cbb23b6)],shared=False,stateful=True,updated_at=2022-09-04T01:12:18Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:18.614110 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-0d91435c-58a4-4ed7-89a7-aad63f16c05a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (823d270d-d081-4de7-bd25-a956697a6925), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:18.614817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0d91435c-58a4-4ed7-89a7-aad63f16c05a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:12:18Z,description=,direction='ingress',ethertype='IPv6',id=8738aa26-6f3f-4a3e-946a-87b085f299dd,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5c147b2ed0724f149841d070b16f749d',protocol=,remote_address_group_id=,remote_group_id=823d270d-d081-4de7-bd25-a956697a6925,remote_ip_prefix=,revision_number=0,security_group_id=823d270d-d081-4de7-bd25-a956697a6925,updated_at=2022-09-04T01:12:18Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:18.615250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-0d91435c-58a4-4ed7-89a7-aad63f16c05a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (8738aa26-6f3f-4a3e-946a-87b085f299dd), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:18.615652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-0d91435c-58a4-4ed7-89a7-aad63f16c05a admin admin] Security group rule updated ['823d270d-d081-4de7-bd25-a956697a6925'] Sep 04 01:12:18.616626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0d91435c-58a4-4ed7-89a7-aad63f16c05a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:12:18Z,description=,direction='egress',ethertype='IPv4',id=a1ebe903-1d64-453f-b856-4ca5306c46f4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5c147b2ed0724f149841d070b16f749d',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=823d270d-d081-4de7-bd25-a956697a6925,updated_at=2022-09-04T01:12:18Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:18.617006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-0d91435c-58a4-4ed7-89a7-aad63f16c05a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (a1ebe903-1d64-453f-b856-4ca5306c46f4), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:18.617358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-0d91435c-58a4-4ed7-89a7-aad63f16c05a admin admin] Security group rule updated ['823d270d-d081-4de7-bd25-a956697a6925'] Sep 04 01:12:18.618051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0d91435c-58a4-4ed7-89a7-aad63f16c05a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:12:18Z,description=,direction='egress',ethertype='IPv6',id=d58bd2cd-2732-4911-bf47-b756d18f7f7e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5c147b2ed0724f149841d070b16f749d',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=823d270d-d081-4de7-bd25-a956697a6925,updated_at=2022-09-04T01:12:18Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:18.618484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-0d91435c-58a4-4ed7-89a7-aad63f16c05a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (d58bd2cd-2732-4911-bf47-b756d18f7f7e), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:18.618728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-0d91435c-58a4-4ed7-89a7-aad63f16c05a admin admin] Security group rule updated ['823d270d-d081-4de7-bd25-a956697a6925'] Sep 04 01:12:18.619455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0d91435c-58a4-4ed7-89a7-aad63f16c05a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:12:18Z,description=,direction='ingress',ethertype='IPv4',id=da14d2c0-75fe-4069-a22d-ed2c2cbb23b6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5c147b2ed0724f149841d070b16f749d',protocol=,remote_address_group_id=,remote_group_id=823d270d-d081-4de7-bd25-a956697a6925,remote_ip_prefix=,revision_number=0,security_group_id=823d270d-d081-4de7-bd25-a956697a6925,updated_at=2022-09-04T01:12:18Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:18.619804 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-0d91435c-58a4-4ed7-89a7-aad63f16c05a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (da14d2c0-75fe-4069-a22d-ed2c2cbb23b6), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:18.620126 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-0d91435c-58a4-4ed7-89a7-aad63f16c05a admin admin] Security group rule updated ['823d270d-d081-4de7-bd25-a956697a6925'] Sep 04 01:12:18.796309 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-54b4d18f-939d-49df-b1d3-b9970c512de7 admin admin] Resource SecurityGroup deleted: 823d270d-d081-4de7-bd25-a956697a6925 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:18.796604 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-54b4d18f-939d-49df-b1d3-b9970c512de7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (823d270d-d081-4de7-bd25-a956697a6925), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:18.797105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54b4d18f-939d-49df-b1d3-b9970c512de7 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('823d270d-d081-4de7-bd25-a956697a6925',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:12:18.810591 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-54b4d18f-939d-49df-b1d3-b9970c512de7 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('823d270d-d081-4de7-bd25-a956697a6925',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:12:18.811209 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-54b4d18f-939d-49df-b1d3-b9970c512de7 admin admin] Resource SecurityGroupRule deleted: 8738aa26-6f3f-4a3e-946a-87b085f299dd {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:18.812483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-54b4d18f-939d-49df-b1d3-b9970c512de7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (8738aa26-6f3f-4a3e-946a-87b085f299dd), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:18.812871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-54b4d18f-939d-49df-b1d3-b9970c512de7 admin admin] Security group rule updated ['823d270d-d081-4de7-bd25-a956697a6925'] Sep 04 01:12:18.813578 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-54b4d18f-939d-49df-b1d3-b9970c512de7 admin admin] Resource SecurityGroupRule deleted: a1ebe903-1d64-453f-b856-4ca5306c46f4 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:18.814223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-54b4d18f-939d-49df-b1d3-b9970c512de7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (a1ebe903-1d64-453f-b856-4ca5306c46f4), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:18.814645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-54b4d18f-939d-49df-b1d3-b9970c512de7 admin admin] Security group rule updated ['823d270d-d081-4de7-bd25-a956697a6925'] Sep 04 01:12:18.815173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-54b4d18f-939d-49df-b1d3-b9970c512de7 admin admin] Resource SecurityGroupRule deleted: d58bd2cd-2732-4911-bf47-b756d18f7f7e {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:18.815575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-54b4d18f-939d-49df-b1d3-b9970c512de7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (d58bd2cd-2732-4911-bf47-b756d18f7f7e), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:18.816118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-54b4d18f-939d-49df-b1d3-b9970c512de7 admin admin] Security group rule updated ['823d270d-d081-4de7-bd25-a956697a6925'] Sep 04 01:12:18.816779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-54b4d18f-939d-49df-b1d3-b9970c512de7 admin admin] Resource SecurityGroupRule deleted: da14d2c0-75fe-4069-a22d-ed2c2cbb23b6 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:18.817225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-54b4d18f-939d-49df-b1d3-b9970c512de7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (da14d2c0-75fe-4069-a22d-ed2c2cbb23b6), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:18.817655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-54b4d18f-939d-49df-b1d3-b9970c512de7 admin admin] Security group rule updated ['823d270d-d081-4de7-bd25-a956697a6925'] Sep 04 01:12:19.550539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-ee9f4159-3324-4127-9926-97264f5c223a admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:12:19Z,description='Default security group',id=e24a194e-ec58-4f6c-b19a-cc75bfff021e,is_default=True,name='default',project_id='82f9366e31bc45a6b94fafa49bdec9c9',revision_number=1,rules=[SecurityGroupRule(2faaed85-62f6-4316-80c4-9a4288e87d3a),SecurityGroupRule(5b253922-0aeb-4800-8409-a42d928f3e80),SecurityGroupRule(c27e707a-2a8e-42a9-9198-8046083904b1),SecurityGroupRule(f9f9dac7-3be9-439d-982f-0ad6e44c2a22)],shared=False,stateful=True,updated_at=2022-09-04T01:12:19Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:19.550925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-ee9f4159-3324-4127-9926-97264f5c223a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (e24a194e-ec58-4f6c-b19a-cc75bfff021e), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:19.551580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-ee9f4159-3324-4127-9926-97264f5c223a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:12:19Z,description=,direction='ingress',ethertype='IPv6',id=2faaed85-62f6-4316-80c4-9a4288e87d3a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='82f9366e31bc45a6b94fafa49bdec9c9',protocol=,remote_address_group_id=,remote_group_id=e24a194e-ec58-4f6c-b19a-cc75bfff021e,remote_ip_prefix=,revision_number=0,security_group_id=e24a194e-ec58-4f6c-b19a-cc75bfff021e,updated_at=2022-09-04T01:12:19Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:19.551942 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-ee9f4159-3324-4127-9926-97264f5c223a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (2faaed85-62f6-4316-80c4-9a4288e87d3a), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:19.552281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-ee9f4159-3324-4127-9926-97264f5c223a admin admin] Security group rule updated ['e24a194e-ec58-4f6c-b19a-cc75bfff021e'] Sep 04 01:12:19.552994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-ee9f4159-3324-4127-9926-97264f5c223a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:12:19Z,description=,direction='egress',ethertype='IPv4',id=5b253922-0aeb-4800-8409-a42d928f3e80,normalized_cidr=None,port_range_max=,port_range_min=,project_id='82f9366e31bc45a6b94fafa49bdec9c9',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e24a194e-ec58-4f6c-b19a-cc75bfff021e,updated_at=2022-09-04T01:12:19Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:19.553385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-ee9f4159-3324-4127-9926-97264f5c223a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (5b253922-0aeb-4800-8409-a42d928f3e80), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:19.553717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-ee9f4159-3324-4127-9926-97264f5c223a admin admin] Security group rule updated ['e24a194e-ec58-4f6c-b19a-cc75bfff021e'] Sep 04 01:12:19.554426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-ee9f4159-3324-4127-9926-97264f5c223a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:12:19Z,description=,direction='ingress',ethertype='IPv4',id=c27e707a-2a8e-42a9-9198-8046083904b1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='82f9366e31bc45a6b94fafa49bdec9c9',protocol=,remote_address_group_id=,remote_group_id=e24a194e-ec58-4f6c-b19a-cc75bfff021e,remote_ip_prefix=,revision_number=0,security_group_id=e24a194e-ec58-4f6c-b19a-cc75bfff021e,updated_at=2022-09-04T01:12:19Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:19.554782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-ee9f4159-3324-4127-9926-97264f5c223a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (c27e707a-2a8e-42a9-9198-8046083904b1), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:19.555139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-ee9f4159-3324-4127-9926-97264f5c223a admin admin] Security group rule updated ['e24a194e-ec58-4f6c-b19a-cc75bfff021e'] Sep 04 01:12:19.555870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-ee9f4159-3324-4127-9926-97264f5c223a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:12:19Z,description=,direction='egress',ethertype='IPv6',id=f9f9dac7-3be9-439d-982f-0ad6e44c2a22,normalized_cidr=None,port_range_max=,port_range_min=,project_id='82f9366e31bc45a6b94fafa49bdec9c9',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e24a194e-ec58-4f6c-b19a-cc75bfff021e,updated_at=2022-09-04T01:12:19Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:19.556221 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-ee9f4159-3324-4127-9926-97264f5c223a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (f9f9dac7-3be9-439d-982f-0ad6e44c2a22), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:19.556547 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-ee9f4159-3324-4127-9926-97264f5c223a admin admin] Security group rule updated ['e24a194e-ec58-4f6c-b19a-cc75bfff021e'] Sep 04 01:12:19.763214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-762ba51b-e14f-4360-bba5-8b8fbdaf8831 admin admin] Resource SecurityGroup deleted: e24a194e-ec58-4f6c-b19a-cc75bfff021e {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:19.763589 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-762ba51b-e14f-4360-bba5-8b8fbdaf8831 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (e24a194e-ec58-4f6c-b19a-cc75bfff021e), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:19.764155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-762ba51b-e14f-4360-bba5-8b8fbdaf8831 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('e24a194e-ec58-4f6c-b19a-cc75bfff021e',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:12:19.776265 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-762ba51b-e14f-4360-bba5-8b8fbdaf8831 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('e24a194e-ec58-4f6c-b19a-cc75bfff021e',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:12:19.776739 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-762ba51b-e14f-4360-bba5-8b8fbdaf8831 admin admin] Resource SecurityGroupRule deleted: 2faaed85-62f6-4316-80c4-9a4288e87d3a {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:19.777129 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-762ba51b-e14f-4360-bba5-8b8fbdaf8831 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (2faaed85-62f6-4316-80c4-9a4288e87d3a), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:19.777463 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-762ba51b-e14f-4360-bba5-8b8fbdaf8831 admin admin] Security group rule updated ['e24a194e-ec58-4f6c-b19a-cc75bfff021e'] Sep 04 01:12:19.777917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-762ba51b-e14f-4360-bba5-8b8fbdaf8831 admin admin] Resource SecurityGroupRule deleted: 5b253922-0aeb-4800-8409-a42d928f3e80 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:19.778261 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-762ba51b-e14f-4360-bba5-8b8fbdaf8831 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (5b253922-0aeb-4800-8409-a42d928f3e80), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:19.778609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-762ba51b-e14f-4360-bba5-8b8fbdaf8831 admin admin] Security group rule updated ['e24a194e-ec58-4f6c-b19a-cc75bfff021e'] Sep 04 01:12:19.779036 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-762ba51b-e14f-4360-bba5-8b8fbdaf8831 admin admin] Resource SecurityGroupRule deleted: c27e707a-2a8e-42a9-9198-8046083904b1 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:19.779421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-762ba51b-e14f-4360-bba5-8b8fbdaf8831 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (c27e707a-2a8e-42a9-9198-8046083904b1), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:19.779734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-762ba51b-e14f-4360-bba5-8b8fbdaf8831 admin admin] Security group rule updated ['e24a194e-ec58-4f6c-b19a-cc75bfff021e'] Sep 04 01:12:19.780145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-762ba51b-e14f-4360-bba5-8b8fbdaf8831 admin admin] Resource SecurityGroupRule deleted: f9f9dac7-3be9-439d-982f-0ad6e44c2a22 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:19.780521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-762ba51b-e14f-4360-bba5-8b8fbdaf8831 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (f9f9dac7-3be9-439d-982f-0ad6e44c2a22), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:19.780845 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-762ba51b-e14f-4360-bba5-8b8fbdaf8831 admin admin] Security group rule updated ['e24a194e-ec58-4f6c-b19a-cc75bfff021e'] Sep 04 01:12:20.473041 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:465 started Sep 04 01:12:20.475715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade56e5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=867000000,duration_sec=949,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:12:20.476432 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:12:20.480821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:465 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:12:22.474293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:466 started Sep 04 01:12:22.477290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade56e7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=868000000,duration_sec=951,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:12:22.477862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:12:22.478298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:466 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:12:24.117679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Resource Port d072bfcf-41bd-430e-800c-1d1a3b17d915 updated (revision_number 6->7). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:12:24.118266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (d072bfcf-41bd-430e-800c-1d1a3b17d915), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:24.475652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:467 started Sep 04 01:12:24.478327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade56e9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=870000000,duration_sec=953,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:12:24.478955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:12:24.482770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:467 - starting polling. Elapsed:0.004 Sep 04 01:12:24.482770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:24.486311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:467 - port information retrieved. Elapsed:0.011 Sep 04 01:12:24.486798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:467 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 04 01:12:26.149373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Resource Port d072bfcf-41bd-430e-800c-1d1a3b17d915 updated (revision_number 7->8). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:12:26.150013 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (d072bfcf-41bd-430e-800c-1d1a3b17d915), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:26.476657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:468 started Sep 04 01:12:26.479085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade56eb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=871000000,duration_sec=955,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:12:26.479649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:12:26.479981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:468 - starting polling. Elapsed:0.004 Sep 04 01:12:26.482368 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:26.489230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:468 - port information retrieved. Elapsed:0.009 Sep 04 01:12:26.489230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:468 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Sep 04 01:12:27.346057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0bbd9061-9fde-4ee7-b058-ce5537b6b713 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:12:27Z,description='Default security group',id=b1fb1890-2d79-4017-a214-0ba455f2d5d9,is_default=True,name='default',project_id='2229967a2f824dd4ad40828726280715',revision_number=1,rules=[SecurityGroupRule(14e347ff-3975-4704-aa2b-fba51d5ca14f),SecurityGroupRule(99980450-1cb2-432f-ad4e-c011de577486),SecurityGroupRule(a38d4cba-0849-43c8-9073-4fd404226fb2),SecurityGroupRule(df2db4a9-740c-414e-a8c4-93b067cb3674)],shared=False,stateful=True,updated_at=2022-09-04T01:12:27Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:27.346650 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-0bbd9061-9fde-4ee7-b058-ce5537b6b713 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (b1fb1890-2d79-4017-a214-0ba455f2d5d9), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:27.347196 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0bbd9061-9fde-4ee7-b058-ce5537b6b713 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:12:27Z,description=,direction='ingress',ethertype='IPv4',id=14e347ff-3975-4704-aa2b-fba51d5ca14f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2229967a2f824dd4ad40828726280715',protocol=,remote_address_group_id=,remote_group_id=b1fb1890-2d79-4017-a214-0ba455f2d5d9,remote_ip_prefix=,revision_number=0,security_group_id=b1fb1890-2d79-4017-a214-0ba455f2d5d9,updated_at=2022-09-04T01:12:27Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:27.347556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-0bbd9061-9fde-4ee7-b058-ce5537b6b713 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (14e347ff-3975-4704-aa2b-fba51d5ca14f), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:27.347888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-0bbd9061-9fde-4ee7-b058-ce5537b6b713 admin admin] Security group rule updated ['b1fb1890-2d79-4017-a214-0ba455f2d5d9'] Sep 04 01:12:27.348660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0bbd9061-9fde-4ee7-b058-ce5537b6b713 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:12:27Z,description=,direction='ingress',ethertype='IPv6',id=99980450-1cb2-432f-ad4e-c011de577486,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2229967a2f824dd4ad40828726280715',protocol=,remote_address_group_id=,remote_group_id=b1fb1890-2d79-4017-a214-0ba455f2d5d9,remote_ip_prefix=,revision_number=0,security_group_id=b1fb1890-2d79-4017-a214-0ba455f2d5d9,updated_at=2022-09-04T01:12:27Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:27.349017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-0bbd9061-9fde-4ee7-b058-ce5537b6b713 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (99980450-1cb2-432f-ad4e-c011de577486), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:27.349424 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-0bbd9061-9fde-4ee7-b058-ce5537b6b713 admin admin] Security group rule updated ['b1fb1890-2d79-4017-a214-0ba455f2d5d9'] Sep 04 01:12:27.350118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0bbd9061-9fde-4ee7-b058-ce5537b6b713 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:12:27Z,description=,direction='egress',ethertype='IPv6',id=a38d4cba-0849-43c8-9073-4fd404226fb2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2229967a2f824dd4ad40828726280715',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=b1fb1890-2d79-4017-a214-0ba455f2d5d9,updated_at=2022-09-04T01:12:27Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:27.350471 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-0bbd9061-9fde-4ee7-b058-ce5537b6b713 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (a38d4cba-0849-43c8-9073-4fd404226fb2), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:27.350796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-0bbd9061-9fde-4ee7-b058-ce5537b6b713 admin admin] Security group rule updated ['b1fb1890-2d79-4017-a214-0ba455f2d5d9'] Sep 04 01:12:27.351479 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0bbd9061-9fde-4ee7-b058-ce5537b6b713 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:12:27Z,description=,direction='egress',ethertype='IPv4',id=df2db4a9-740c-414e-a8c4-93b067cb3674,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2229967a2f824dd4ad40828726280715',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=b1fb1890-2d79-4017-a214-0ba455f2d5d9,updated_at=2022-09-04T01:12:27Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:27.351827 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-0bbd9061-9fde-4ee7-b058-ce5537b6b713 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (df2db4a9-740c-414e-a8c4-93b067cb3674), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:27.352148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-0bbd9061-9fde-4ee7-b058-ce5537b6b713 admin admin] Security group rule updated ['b1fb1890-2d79-4017-a214-0ba455f2d5d9'] Sep 04 01:12:27.882369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-99464798-b4d1-42da-ab88-3160fcc21c74 admin admin] Resource SecurityGroup deleted: b1fb1890-2d79-4017-a214-0ba455f2d5d9 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:27.883378 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-99464798-b4d1-42da-ab88-3160fcc21c74 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (b1fb1890-2d79-4017-a214-0ba455f2d5d9), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:27.884226 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99464798-b4d1-42da-ab88-3160fcc21c74 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('b1fb1890-2d79-4017-a214-0ba455f2d5d9',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:12:27.902058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-99464798-b4d1-42da-ab88-3160fcc21c74 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('b1fb1890-2d79-4017-a214-0ba455f2d5d9',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:12:27.903438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-99464798-b4d1-42da-ab88-3160fcc21c74 admin admin] Resource SecurityGroupRule deleted: 14e347ff-3975-4704-aa2b-fba51d5ca14f {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:27.903973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-99464798-b4d1-42da-ab88-3160fcc21c74 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (14e347ff-3975-4704-aa2b-fba51d5ca14f), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:27.904574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-99464798-b4d1-42da-ab88-3160fcc21c74 admin admin] Security group rule updated ['b1fb1890-2d79-4017-a214-0ba455f2d5d9'] Sep 04 01:12:27.905342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-99464798-b4d1-42da-ab88-3160fcc21c74 admin admin] Resource SecurityGroupRule deleted: 99980450-1cb2-432f-ad4e-c011de577486 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:27.905853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-99464798-b4d1-42da-ab88-3160fcc21c74 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (99980450-1cb2-432f-ad4e-c011de577486), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:27.907144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-99464798-b4d1-42da-ab88-3160fcc21c74 admin admin] Security group rule updated ['b1fb1890-2d79-4017-a214-0ba455f2d5d9'] Sep 04 01:12:27.907561 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-99464798-b4d1-42da-ab88-3160fcc21c74 admin admin] Resource SecurityGroupRule deleted: a38d4cba-0849-43c8-9073-4fd404226fb2 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:27.907905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-99464798-b4d1-42da-ab88-3160fcc21c74 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (a38d4cba-0849-43c8-9073-4fd404226fb2), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:27.908382 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-99464798-b4d1-42da-ab88-3160fcc21c74 admin admin] Security group rule updated ['b1fb1890-2d79-4017-a214-0ba455f2d5d9'] Sep 04 01:12:27.913355 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-99464798-b4d1-42da-ab88-3160fcc21c74 admin admin] Resource SecurityGroupRule deleted: df2db4a9-740c-414e-a8c4-93b067cb3674 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:27.913658 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-99464798-b4d1-42da-ab88-3160fcc21c74 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (df2db4a9-740c-414e-a8c4-93b067cb3674), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:27.916699 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-99464798-b4d1-42da-ab88-3160fcc21c74 admin admin] Security group rule updated ['b1fb1890-2d79-4017-a214-0ba455f2d5d9'] Sep 04 01:12:28.478254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:469 started Sep 04 01:12:28.482264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade56ed,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=873000000,duration_sec=957,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:12:28.483203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:12:28.483763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:469 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 04 01:12:28.674804 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b5700504-b07b-44aa-8dff-2812f908cede tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Resource Port deleted: a684da0f-7a2f-4974-8aa3-30875caa5a0e {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:28.675186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b5700504-b07b-44aa-8dff-2812f908cede tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (a684da0f-7a2f-4974-8aa3-30875caa5a0e), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:28.675625 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-b5700504-b07b-44aa-8dff-2812f908cede tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Security group member updated {'4a7c3c8b-10d8-4cc1-bb76-bfc3e0d0e867'} Sep 04 01:12:28.744418 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-e3943b17-a05a-46e9-8214-817862999ab0 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:12:28Z,description='Default security group',id=0d9f9db1-0dd1-4731-8b3a-3bbb79c73377,is_default=True,name='default',project_id='9c0b331a0c17484f89a5f40f21f1ee4b',revision_number=1,rules=[SecurityGroupRule(16061004-3e98-444e-8996-684f1a07c0df),SecurityGroupRule(263f6ab6-36ee-43df-a6e4-424ecf97920c),SecurityGroupRule(4b277608-035a-4b0e-8a31-30d50f8ea358),SecurityGroupRule(a90e4387-d315-4d76-b8df-afebe833fbc8)],shared=False,stateful=True,updated_at=2022-09-04T01:12:28Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:28.745009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-e3943b17-a05a-46e9-8214-817862999ab0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (0d9f9db1-0dd1-4731-8b3a-3bbb79c73377), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:28.745724 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-e3943b17-a05a-46e9-8214-817862999ab0 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:12:28Z,description=,direction='ingress',ethertype='IPv6',id=16061004-3e98-444e-8996-684f1a07c0df,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9c0b331a0c17484f89a5f40f21f1ee4b',protocol=,remote_address_group_id=,remote_group_id=0d9f9db1-0dd1-4731-8b3a-3bbb79c73377,remote_ip_prefix=,revision_number=0,security_group_id=0d9f9db1-0dd1-4731-8b3a-3bbb79c73377,updated_at=2022-09-04T01:12:28Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:28.746178 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-e3943b17-a05a-46e9-8214-817862999ab0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (16061004-3e98-444e-8996-684f1a07c0df), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:28.746577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-e3943b17-a05a-46e9-8214-817862999ab0 admin admin] Security group rule updated ['0d9f9db1-0dd1-4731-8b3a-3bbb79c73377'] Sep 04 01:12:28.747371 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-e3943b17-a05a-46e9-8214-817862999ab0 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:12:28Z,description=,direction='egress',ethertype='IPv4',id=263f6ab6-36ee-43df-a6e4-424ecf97920c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9c0b331a0c17484f89a5f40f21f1ee4b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0d9f9db1-0dd1-4731-8b3a-3bbb79c73377,updated_at=2022-09-04T01:12:28Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:28.747817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-e3943b17-a05a-46e9-8214-817862999ab0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (263f6ab6-36ee-43df-a6e4-424ecf97920c), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:28.748205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-e3943b17-a05a-46e9-8214-817862999ab0 admin admin] Security group rule updated ['0d9f9db1-0dd1-4731-8b3a-3bbb79c73377'] Sep 04 01:12:28.749009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-e3943b17-a05a-46e9-8214-817862999ab0 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:12:28Z,description=,direction='ingress',ethertype='IPv4',id=4b277608-035a-4b0e-8a31-30d50f8ea358,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9c0b331a0c17484f89a5f40f21f1ee4b',protocol=,remote_address_group_id=,remote_group_id=0d9f9db1-0dd1-4731-8b3a-3bbb79c73377,remote_ip_prefix=,revision_number=0,security_group_id=0d9f9db1-0dd1-4731-8b3a-3bbb79c73377,updated_at=2022-09-04T01:12:28Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:28.749449 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-e3943b17-a05a-46e9-8214-817862999ab0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (4b277608-035a-4b0e-8a31-30d50f8ea358), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:28.749902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-e3943b17-a05a-46e9-8214-817862999ab0 admin admin] Security group rule updated ['0d9f9db1-0dd1-4731-8b3a-3bbb79c73377'] Sep 04 01:12:28.750738 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-e3943b17-a05a-46e9-8214-817862999ab0 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:12:28Z,description=,direction='egress',ethertype='IPv6',id=a90e4387-d315-4d76-b8df-afebe833fbc8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9c0b331a0c17484f89a5f40f21f1ee4b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0d9f9db1-0dd1-4731-8b3a-3bbb79c73377,updated_at=2022-09-04T01:12:28Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:28.751327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-e3943b17-a05a-46e9-8214-817862999ab0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (a90e4387-d315-4d76-b8df-afebe833fbc8), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:28.751682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-e3943b17-a05a-46e9-8214-817862999ab0 admin admin] Security group rule updated ['0d9f9db1-0dd1-4731-8b3a-3bbb79c73377'] Sep 04 01:12:29.096916 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-16af2a74-0ad9-42c1-9256-a03d97c36500 admin admin] Resource SecurityGroup deleted: 0d9f9db1-0dd1-4731-8b3a-3bbb79c73377 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:29.097315 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-16af2a74-0ad9-42c1-9256-a03d97c36500 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (0d9f9db1-0dd1-4731-8b3a-3bbb79c73377), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:29.102663 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16af2a74-0ad9-42c1-9256-a03d97c36500 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('0d9f9db1-0dd1-4731-8b3a-3bbb79c73377',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:12:29.119330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-16af2a74-0ad9-42c1-9256-a03d97c36500 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('0d9f9db1-0dd1-4731-8b3a-3bbb79c73377',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:12:29.120247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-16af2a74-0ad9-42c1-9256-a03d97c36500 admin admin] Resource SecurityGroupRule deleted: 16061004-3e98-444e-8996-684f1a07c0df {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:29.120624 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-16af2a74-0ad9-42c1-9256-a03d97c36500 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (16061004-3e98-444e-8996-684f1a07c0df), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:29.120957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-16af2a74-0ad9-42c1-9256-a03d97c36500 admin admin] Security group rule updated ['0d9f9db1-0dd1-4731-8b3a-3bbb79c73377'] Sep 04 01:12:29.121422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-16af2a74-0ad9-42c1-9256-a03d97c36500 admin admin] Resource SecurityGroupRule deleted: 263f6ab6-36ee-43df-a6e4-424ecf97920c {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:29.122901 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-16af2a74-0ad9-42c1-9256-a03d97c36500 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (263f6ab6-36ee-43df-a6e4-424ecf97920c), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:29.123231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-16af2a74-0ad9-42c1-9256-a03d97c36500 admin admin] Security group rule updated ['0d9f9db1-0dd1-4731-8b3a-3bbb79c73377'] Sep 04 01:12:29.123948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-16af2a74-0ad9-42c1-9256-a03d97c36500 admin admin] Resource SecurityGroupRule deleted: 4b277608-035a-4b0e-8a31-30d50f8ea358 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:29.124349 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-16af2a74-0ad9-42c1-9256-a03d97c36500 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (4b277608-035a-4b0e-8a31-30d50f8ea358), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:29.124677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-16af2a74-0ad9-42c1-9256-a03d97c36500 admin admin] Security group rule updated ['0d9f9db1-0dd1-4731-8b3a-3bbb79c73377'] Sep 04 01:12:29.125682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-16af2a74-0ad9-42c1-9256-a03d97c36500 admin admin] Resource SecurityGroupRule deleted: a90e4387-d315-4d76-b8df-afebe833fbc8 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:29.126017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-16af2a74-0ad9-42c1-9256-a03d97c36500 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (a90e4387-d315-4d76-b8df-afebe833fbc8), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:29.127379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-16af2a74-0ad9-42c1-9256-a03d97c36500 admin admin] Security group rule updated ['0d9f9db1-0dd1-4731-8b3a-3bbb79c73377'] Sep 04 01:12:30.478970 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:470 started Sep 04 01:12:30.481506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade56ef,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=873000000,duration_sec=959,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:12:30.482020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:12:30.482350 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:470 - starting polling. Elapsed:0.004 Sep 04 01:12:30.484751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:30.486843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port a684da0f-7a2f-4974-8aa3-30875caa5a0e not present in bridge br-int Sep 04 01:12:30.487222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] net_uuid None not managed by VLAN manager Sep 04 01:12:30.487569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for ['a684da0f-7a2f-4974-8aa3-30875caa5a0e'] Sep 04 01:12:30.487961 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port a684da0f-7a2f-4974-8aa3-30875caa5a0e is not handled by the firewall. {{(pid=107812) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 04 01:12:30.490957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:470 - port information retrieved. Elapsed:0.012 Sep 04 01:12:30.491537 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:470 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Sep 04 01:12:31.215013 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b8d8dc7a-7224-4aa9-97fb-2d7bc4297232 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Resource SecurityGroup deleted: 4a7c3c8b-10d8-4cc1-bb76-bfc3e0d0e867 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:31.215479 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b8d8dc7a-7224-4aa9-97fb-2d7bc4297232 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (4a7c3c8b-10d8-4cc1-bb76-bfc3e0d0e867), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:31.216074 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8d8dc7a-7224-4aa9-97fb-2d7bc4297232 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('4a7c3c8b-10d8-4cc1-bb76-bfc3e0d0e867',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:12:31.230214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b8d8dc7a-7224-4aa9-97fb-2d7bc4297232 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('4a7c3c8b-10d8-4cc1-bb76-bfc3e0d0e867',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:12:31.230688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b8d8dc7a-7224-4aa9-97fb-2d7bc4297232 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Resource SecurityGroupRule deleted: 7dc709b6-05e8-43f1-80f2-810dafa8a388 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:31.231059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b8d8dc7a-7224-4aa9-97fb-2d7bc4297232 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (7dc709b6-05e8-43f1-80f2-810dafa8a388), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:31.231400 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-b8d8dc7a-7224-4aa9-97fb-2d7bc4297232 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Security group rule updated ['4a7c3c8b-10d8-4cc1-bb76-bfc3e0d0e867'] Sep 04 01:12:31.231843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b8d8dc7a-7224-4aa9-97fb-2d7bc4297232 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Resource SecurityGroupRule deleted: 9ecebf24-15ae-4e4b-8fd0-7d3c66433f00 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:31.232187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b8d8dc7a-7224-4aa9-97fb-2d7bc4297232 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (9ecebf24-15ae-4e4b-8fd0-7d3c66433f00), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:31.232511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-b8d8dc7a-7224-4aa9-97fb-2d7bc4297232 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Security group rule updated ['4a7c3c8b-10d8-4cc1-bb76-bfc3e0d0e867'] Sep 04 01:12:31.233158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b8d8dc7a-7224-4aa9-97fb-2d7bc4297232 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Resource SecurityGroupRule deleted: 973ecaf9-b003-4a4c-b650-656a00d0e985 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:31.233529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b8d8dc7a-7224-4aa9-97fb-2d7bc4297232 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (973ecaf9-b003-4a4c-b650-656a00d0e985), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:31.233852 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-b8d8dc7a-7224-4aa9-97fb-2d7bc4297232 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Security group rule updated ['4a7c3c8b-10d8-4cc1-bb76-bfc3e0d0e867'] Sep 04 01:12:31.234782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b8d8dc7a-7224-4aa9-97fb-2d7bc4297232 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Resource SecurityGroupRule deleted: 0cea0857-fafa-4498-b594-2f28583781fc {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:31.235237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b8d8dc7a-7224-4aa9-97fb-2d7bc4297232 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (0cea0857-fafa-4498-b594-2f28583781fc), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:31.235631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-b8d8dc7a-7224-4aa9-97fb-2d7bc4297232 tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Security group rule updated ['4a7c3c8b-10d8-4cc1-bb76-bfc3e0d0e867'] Sep 04 01:12:31.685322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-7ac34a2f-605c-47bc-ab24-0159655f20dd tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Resource Port deleted: 4b9f3ca7-e9f5-4a2e-ab65-402ed81ac4dc {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:31.685995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-7ac34a2f-605c-47bc-ab24-0159655f20dd tempest-AttachVolumeNegativeTest-825474236 tempest-AttachVolumeNegativeTest-825474236-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (4b9f3ca7-e9f5-4a2e-ab65-402ed81ac4dc), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:32.480786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:471 started Sep 04 01:12:32.483638 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade56f1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=875000000,duration_sec=961,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:12:32.484734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:12:32.485198 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:471 - starting polling. Elapsed:0.005 Sep 04 01:12:32.487645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:32.489217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 4b9f3ca7-e9f5-4a2e-ab65-402ed81ac4dc not present in bridge br-int Sep 04 01:12:32.489548 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] net_uuid None not managed by VLAN manager Sep 04 01:12:32.489831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for ['4b9f3ca7-e9f5-4a2e-ab65-402ed81ac4dc'] Sep 04 01:12:32.490151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 4b9f3ca7-e9f5-4a2e-ab65-402ed81ac4dc is not handled by the firewall. {{(pid=107812) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 04 01:12:32.493569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:471 - port information retrieved. Elapsed:0.013 Sep 04 01:12:32.493902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:471 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Sep 04 01:12:34.481397 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:472 started Sep 04 01:12:34.485330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade56f3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=875000000,duration_sec=963,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:12:34.485330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:12:34.485330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:472 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:12:36.482320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:473 started Sep 04 01:12:36.486574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade56f5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=877000000,duration_sec=965,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:12:36.487297 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:12:36.487715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:473 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 04 01:12:36.975379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c3dec64b-7d51-42cf-9472-54385c3ec925 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:12:36Z,description='Default security group',id=f4342c5c-2dca-4ef0-963b-1d466cbbf658,is_default=True,name='default',project_id='793bd52dc1be46888c6a54c22a46be0a',revision_number=1,rules=[SecurityGroupRule(70d4538c-03a6-443f-8392-e5858b603840),SecurityGroupRule(97a84550-050a-46c2-b12f-c537c4c89413),SecurityGroupRule(a3f37fb9-cb1b-4ca0-b320-55d925f295eb),SecurityGroupRule(e1039de3-9d8e-477c-878e-7eab011ba0d5)],shared=False,stateful=True,updated_at=2022-09-04T01:12:36Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:36.975757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-c3dec64b-7d51-42cf-9472-54385c3ec925 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (f4342c5c-2dca-4ef0-963b-1d466cbbf658), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:36.976584 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c3dec64b-7d51-42cf-9472-54385c3ec925 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:12:36Z,description=,direction='egress',ethertype='IPv4',id=70d4538c-03a6-443f-8392-e5858b603840,normalized_cidr=None,port_range_max=,port_range_min=,project_id='793bd52dc1be46888c6a54c22a46be0a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=f4342c5c-2dca-4ef0-963b-1d466cbbf658,updated_at=2022-09-04T01:12:36Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:36.976921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-c3dec64b-7d51-42cf-9472-54385c3ec925 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (70d4538c-03a6-443f-8392-e5858b603840), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:36.977312 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-c3dec64b-7d51-42cf-9472-54385c3ec925 admin admin] Security group rule updated ['f4342c5c-2dca-4ef0-963b-1d466cbbf658'] Sep 04 01:12:36.978045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c3dec64b-7d51-42cf-9472-54385c3ec925 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:12:36Z,description=,direction='ingress',ethertype='IPv6',id=97a84550-050a-46c2-b12f-c537c4c89413,normalized_cidr=None,port_range_max=,port_range_min=,project_id='793bd52dc1be46888c6a54c22a46be0a',protocol=,remote_address_group_id=,remote_group_id=f4342c5c-2dca-4ef0-963b-1d466cbbf658,remote_ip_prefix=,revision_number=0,security_group_id=f4342c5c-2dca-4ef0-963b-1d466cbbf658,updated_at=2022-09-04T01:12:36Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:36.978385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-c3dec64b-7d51-42cf-9472-54385c3ec925 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (97a84550-050a-46c2-b12f-c537c4c89413), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:36.978706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-c3dec64b-7d51-42cf-9472-54385c3ec925 admin admin] Security group rule updated ['f4342c5c-2dca-4ef0-963b-1d466cbbf658'] Sep 04 01:12:36.979397 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c3dec64b-7d51-42cf-9472-54385c3ec925 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:12:36Z,description=,direction='egress',ethertype='IPv6',id=a3f37fb9-cb1b-4ca0-b320-55d925f295eb,normalized_cidr=None,port_range_max=,port_range_min=,project_id='793bd52dc1be46888c6a54c22a46be0a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=f4342c5c-2dca-4ef0-963b-1d466cbbf658,updated_at=2022-09-04T01:12:36Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:36.979744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-c3dec64b-7d51-42cf-9472-54385c3ec925 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (a3f37fb9-cb1b-4ca0-b320-55d925f295eb), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:36.980067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-c3dec64b-7d51-42cf-9472-54385c3ec925 admin admin] Security group rule updated ['f4342c5c-2dca-4ef0-963b-1d466cbbf658'] Sep 04 01:12:36.980767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c3dec64b-7d51-42cf-9472-54385c3ec925 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:12:36Z,description=,direction='ingress',ethertype='IPv4',id=e1039de3-9d8e-477c-878e-7eab011ba0d5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='793bd52dc1be46888c6a54c22a46be0a',protocol=,remote_address_group_id=,remote_group_id=f4342c5c-2dca-4ef0-963b-1d466cbbf658,remote_ip_prefix=,revision_number=0,security_group_id=f4342c5c-2dca-4ef0-963b-1d466cbbf658,updated_at=2022-09-04T01:12:36Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:36.981132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-c3dec64b-7d51-42cf-9472-54385c3ec925 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (e1039de3-9d8e-477c-878e-7eab011ba0d5), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:36.981456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-c3dec64b-7d51-42cf-9472-54385c3ec925 admin admin] Security group rule updated ['f4342c5c-2dca-4ef0-963b-1d466cbbf658'] Sep 04 01:12:37.022640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-8384c146-054c-4939-b466-3b4cc75a74b0 admin admin] Resource Port deleted: a6788698-0516-4d8a-8fe8-2add6e7f6e94 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:37.023984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-8384c146-054c-4939-b466-3b4cc75a74b0 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (a6788698-0516-4d8a-8fe8-2add6e7f6e94), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:37.176590 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0485e98d-bf1f-412c-a6b3-1b2a2d27294c admin admin] Resource SecurityGroup deleted: f4342c5c-2dca-4ef0-963b-1d466cbbf658 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:37.177239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-0485e98d-bf1f-412c-a6b3-1b2a2d27294c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (f4342c5c-2dca-4ef0-963b-1d466cbbf658), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:37.178682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0485e98d-bf1f-412c-a6b3-1b2a2d27294c admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('f4342c5c-2dca-4ef0-963b-1d466cbbf658',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:12:37.194863 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0485e98d-bf1f-412c-a6b3-1b2a2d27294c admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('f4342c5c-2dca-4ef0-963b-1d466cbbf658',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:12:37.195642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0485e98d-bf1f-412c-a6b3-1b2a2d27294c admin admin] Resource SecurityGroupRule deleted: 70d4538c-03a6-443f-8392-e5858b603840 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:37.196030 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-0485e98d-bf1f-412c-a6b3-1b2a2d27294c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (70d4538c-03a6-443f-8392-e5858b603840), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:37.196950 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-0485e98d-bf1f-412c-a6b3-1b2a2d27294c admin admin] Security group rule updated ['f4342c5c-2dca-4ef0-963b-1d466cbbf658'] Sep 04 01:12:37.197522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0485e98d-bf1f-412c-a6b3-1b2a2d27294c admin admin] Resource SecurityGroupRule deleted: 97a84550-050a-46c2-b12f-c537c4c89413 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:37.197967 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-0485e98d-bf1f-412c-a6b3-1b2a2d27294c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (97a84550-050a-46c2-b12f-c537c4c89413), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:37.198550 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-0485e98d-bf1f-412c-a6b3-1b2a2d27294c admin admin] Security group rule updated ['f4342c5c-2dca-4ef0-963b-1d466cbbf658'] Sep 04 01:12:37.199046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0485e98d-bf1f-412c-a6b3-1b2a2d27294c admin admin] Resource SecurityGroupRule deleted: a3f37fb9-cb1b-4ca0-b320-55d925f295eb {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:37.199598 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-0485e98d-bf1f-412c-a6b3-1b2a2d27294c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (a3f37fb9-cb1b-4ca0-b320-55d925f295eb), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:37.199874 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-0485e98d-bf1f-412c-a6b3-1b2a2d27294c admin admin] Security group rule updated ['f4342c5c-2dca-4ef0-963b-1d466cbbf658'] Sep 04 01:12:37.200479 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0485e98d-bf1f-412c-a6b3-1b2a2d27294c admin admin] Resource SecurityGroupRule deleted: e1039de3-9d8e-477c-878e-7eab011ba0d5 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:37.201678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-0485e98d-bf1f-412c-a6b3-1b2a2d27294c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (e1039de3-9d8e-477c-878e-7eab011ba0d5), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:37.202330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-0485e98d-bf1f-412c-a6b3-1b2a2d27294c admin admin] Security group rule updated ['f4342c5c-2dca-4ef0-963b-1d466cbbf658'] Sep 04 01:12:38.046528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["880e2935-1de3-49f7-9025-0d6d9e028416","delete","qr-a6788698-05",20,["map",[["attached-mac","fa:16:3e:f9:50:ed"],["iface-id","a6788698-0516-4d8a-8fe8-2add6e7f6e94"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:12:38.063408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-fab86979-6ad8-41e3-8c75-3dcb74a145de admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:12:37Z,description='Default security group',id=1308154c-22da-4eba-a0a2-69dfad106fa8,is_default=True,name='default',project_id='e1b11403119042b293cce37def798c23',revision_number=1,rules=[SecurityGroupRule(0705762c-46e1-4893-a6ef-26b2211bf2e4),SecurityGroupRule(23459bae-f588-4cba-8333-014b996913d2),SecurityGroupRule(2374358f-1c6f-46b3-9fd6-acceabb1d10d),SecurityGroupRule(557e84a2-8674-43d5-bd17-10da66c6195c)],shared=False,stateful=True,updated_at=2022-09-04T01:12:37Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:38.064453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-fab86979-6ad8-41e3-8c75-3dcb74a145de admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (1308154c-22da-4eba-a0a2-69dfad106fa8), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:38.065140 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-fab86979-6ad8-41e3-8c75-3dcb74a145de admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:12:37Z,description=,direction='ingress',ethertype='IPv6',id=0705762c-46e1-4893-a6ef-26b2211bf2e4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e1b11403119042b293cce37def798c23',protocol=,remote_address_group_id=,remote_group_id=1308154c-22da-4eba-a0a2-69dfad106fa8,remote_ip_prefix=,revision_number=0,security_group_id=1308154c-22da-4eba-a0a2-69dfad106fa8,updated_at=2022-09-04T01:12:37Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:38.065744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-fab86979-6ad8-41e3-8c75-3dcb74a145de admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (0705762c-46e1-4893-a6ef-26b2211bf2e4), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:38.066157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-fab86979-6ad8-41e3-8c75-3dcb74a145de admin admin] Security group rule updated ['1308154c-22da-4eba-a0a2-69dfad106fa8'] Sep 04 01:12:38.067086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-fab86979-6ad8-41e3-8c75-3dcb74a145de admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:12:37Z,description=,direction='ingress',ethertype='IPv4',id=23459bae-f588-4cba-8333-014b996913d2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e1b11403119042b293cce37def798c23',protocol=,remote_address_group_id=,remote_group_id=1308154c-22da-4eba-a0a2-69dfad106fa8,remote_ip_prefix=,revision_number=0,security_group_id=1308154c-22da-4eba-a0a2-69dfad106fa8,updated_at=2022-09-04T01:12:37Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:38.067518 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-fab86979-6ad8-41e3-8c75-3dcb74a145de admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (23459bae-f588-4cba-8333-014b996913d2), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:38.067917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-fab86979-6ad8-41e3-8c75-3dcb74a145de admin admin] Security group rule updated ['1308154c-22da-4eba-a0a2-69dfad106fa8'] Sep 04 01:12:38.068693 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-fab86979-6ad8-41e3-8c75-3dcb74a145de admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:12:37Z,description=,direction='egress',ethertype='IPv4',id=2374358f-1c6f-46b3-9fd6-acceabb1d10d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e1b11403119042b293cce37def798c23',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=1308154c-22da-4eba-a0a2-69dfad106fa8,updated_at=2022-09-04T01:12:37Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:38.069165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-fab86979-6ad8-41e3-8c75-3dcb74a145de admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (2374358f-1c6f-46b3-9fd6-acceabb1d10d), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:38.069651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-fab86979-6ad8-41e3-8c75-3dcb74a145de admin admin] Security group rule updated ['1308154c-22da-4eba-a0a2-69dfad106fa8'] Sep 04 01:12:38.070573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-fab86979-6ad8-41e3-8c75-3dcb74a145de admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:12:37Z,description=,direction='egress',ethertype='IPv6',id=557e84a2-8674-43d5-bd17-10da66c6195c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e1b11403119042b293cce37def798c23',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=1308154c-22da-4eba-a0a2-69dfad106fa8,updated_at=2022-09-04T01:12:37Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:38.070991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-fab86979-6ad8-41e3-8c75-3dcb74a145de admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (557e84a2-8674-43d5-bd17-10da66c6195c), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:38.071520 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-fab86979-6ad8-41e3-8c75-3dcb74a145de admin admin] Security group rule updated ['1308154c-22da-4eba-a0a2-69dfad106fa8'] Sep 04 01:12:38.293812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-abfff426-ec69-42ac-826e-c7b894e85a67 admin admin] Resource SecurityGroup deleted: 1308154c-22da-4eba-a0a2-69dfad106fa8 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:38.294220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-abfff426-ec69-42ac-826e-c7b894e85a67 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (1308154c-22da-4eba-a0a2-69dfad106fa8), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:38.294943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abfff426-ec69-42ac-826e-c7b894e85a67 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('1308154c-22da-4eba-a0a2-69dfad106fa8',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:12:38.312321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-abfff426-ec69-42ac-826e-c7b894e85a67 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('1308154c-22da-4eba-a0a2-69dfad106fa8',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:12:38.312970 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-abfff426-ec69-42ac-826e-c7b894e85a67 admin admin] Resource SecurityGroupRule deleted: 0705762c-46e1-4893-a6ef-26b2211bf2e4 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:38.313548 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-abfff426-ec69-42ac-826e-c7b894e85a67 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (0705762c-46e1-4893-a6ef-26b2211bf2e4), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:38.313934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-abfff426-ec69-42ac-826e-c7b894e85a67 admin admin] Security group rule updated ['1308154c-22da-4eba-a0a2-69dfad106fa8'] Sep 04 01:12:38.314873 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-abfff426-ec69-42ac-826e-c7b894e85a67 admin admin] Resource SecurityGroupRule deleted: 23459bae-f588-4cba-8333-014b996913d2 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:38.315703 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-abfff426-ec69-42ac-826e-c7b894e85a67 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (23459bae-f588-4cba-8333-014b996913d2), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:38.316325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-abfff426-ec69-42ac-826e-c7b894e85a67 admin admin] Security group rule updated ['1308154c-22da-4eba-a0a2-69dfad106fa8'] Sep 04 01:12:38.317055 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-abfff426-ec69-42ac-826e-c7b894e85a67 admin admin] Resource SecurityGroupRule deleted: 2374358f-1c6f-46b3-9fd6-acceabb1d10d {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:38.318267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-abfff426-ec69-42ac-826e-c7b894e85a67 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (2374358f-1c6f-46b3-9fd6-acceabb1d10d), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:38.318783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-abfff426-ec69-42ac-826e-c7b894e85a67 admin admin] Security group rule updated ['1308154c-22da-4eba-a0a2-69dfad106fa8'] Sep 04 01:12:38.319212 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-abfff426-ec69-42ac-826e-c7b894e85a67 admin admin] Resource SecurityGroupRule deleted: 557e84a2-8674-43d5-bd17-10da66c6195c {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:38.319561 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-abfff426-ec69-42ac-826e-c7b894e85a67 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (557e84a2-8674-43d5-bd17-10da66c6195c), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:38.319884 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-abfff426-ec69-42ac-826e-c7b894e85a67 admin admin] Security group rule updated ['1308154c-22da-4eba-a0a2-69dfad106fa8'] Sep 04 01:12:38.322851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-1c65f275-6abc-4a7b-94b4-efe238fae91d admin admin] Resource Port deleted: 4ed942cd-0f45-4d77-a66d-1d6c875877dc {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:38.323217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-1c65f275-6abc-4a7b-94b4-efe238fae91d admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (4ed942cd-0f45-4d77-a66d-1d6c875877dc), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:38.440705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["21f182fa-e000-4708-8306-2f02a75e38ed","delete","qg-4ed942cd-0f",15,["map",[["attached-mac","fa:16:3e:0e:53:5a"],["iface-id","4ed942cd-0f45-4d77-a66d-1d6c875877dc"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:12:38.483211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:474 started Sep 04 01:12:38.757438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade56f7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=147000000,duration_sec=968,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:12:38.759435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:12:38.760224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:474 - starting polling. Elapsed:0.277 Sep 04 01:12:38.768253 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:38.774498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade56f9,OFPFlowMod(buffer_id=4294967295,command=3,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 20}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:12:38.777399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade56fb,OFPFlowMod(buffer_id=4294967295,command=3,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 15}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:12:38.784686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:474 - port information retrieved. Elapsed:0.295 Sep 04 01:12:38.784686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Starting to process devices in:{'current': {'c2f724af-5dbd-4d91-83cd-c5152b744599', 'da545e71-9e15-495e-b08a-2c36ede84742', '9db3ca9e-27d3-4852-b8c6-3fc745d2d055', '3fa24970-97a7-4f46-ac55-0b24323fa402', '0a1a9f7e-73de-4620-ae03-4b1d50d7f706', '89aa06b4-bbf1-40c2-bb48-500c3aecdf48', '68e4df44-e581-4fa1-922b-1b78021d5d7b', 'e507db86-47c3-4953-96bb-c5e552b4f602', '53e7a39c-e9ce-45c4-84af-632f2aac70ae', '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', 'b4f93563-ff7a-44c4-96a1-87f6e4348648', 'f0af75e4-63aa-44d3-bff7-973c3caf9bf9', '1cf499fb-10a0-4af2-afec-5f610dc85da6', 'ca102ce7-433c-4029-aabf-33d944165ff1'}, 'added': set(), 'removed': {'a6788698-0516-4d8a-8fe8-2add6e7f6e94', '4ed942cd-0f45-4d77-a66d-1d6c875877dc'}, 'updated': set(), 're_added': set()} {{(pid=107812) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 04 01:12:38.784686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:474 - agent port security group processed in 0.000 Sep 04 01:12:38.784686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Configuration for devices up [] and devices down [] completed. Sep 04 01:12:38.785525 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for {'a6788698-0516-4d8a-8fe8-2add6e7f6e94', '4ed942cd-0f45-4d77-a66d-1d6c875877dc'} Sep 04 01:12:38.785525 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 8 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:12:38.842887 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f0fd56-58a1-486d-8a98-215b5921155c]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:12:38.843992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Ports {'a6788698-0516-4d8a-8fe8-2add6e7f6e94', '4ed942cd-0f45-4d77-a66d-1d6c875877dc'} removed Sep 04 01:12:38.890902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port removal failed for set() {{(pid=107812) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 04 01:12:38.891610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:474 - treat_devices_removed completed in 0.110 Sep 04 01:12:38.892620 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:474 - ports processed. Elapsed:0.409 Sep 04 01:12:38.893204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:474 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 2}}. Elapsed:0.410 Sep 04 01:12:38.944404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-85074d28-a74b-4df4-a6ba-ad40b1f43e11 admin admin] Resource Subnet deleted: 1af847f5-eeac-4b3d-afa5-aa099062676b {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:38.945325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-85074d28-a74b-4df4-a6ba-ad40b1f43e11 admin admin] Publish callbacks [] for Subnet (1af847f5-eeac-4b3d-afa5-aa099062676b), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:39.087333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["c7b46d5b-c0b8-4b90-a881-ad88b2523daf","delete","tap0a1a9f7e-73",11,["map",[["attached-mac","fa:16:3e:d1:46:c7"],["iface-id","0a1a9f7e-73de-4620-ae03-4b1d50d7f706"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:12:39.403021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-1c31f77a-4cd0-4654-8832-ea81a00aca9b admin admin] Resource Port deleted: 0a1a9f7e-73de-4620-ae03-4b1d50d7f706 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:39.403411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-1c31f77a-4cd0-4654-8832-ea81a00aca9b admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (0a1a9f7e-73de-4620-ae03-4b1d50d7f706), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:39.412422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-75ab1da8-e70c-439d-91ce-29c66e762b3f None None] Resource Port deleted: 0a1a9f7e-73de-4620-ae03-4b1d50d7f706 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:39.413536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-75ab1da8-e70c-439d-91ce-29c66e762b3f None None] Skipped duplicate delete event for 0a1a9f7e-73de-4620-ae03-4b1d50d7f706 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:209}} Sep 04 01:12:39.740103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-1c31f77a-4cd0-4654-8832-ea81a00aca9b admin admin] Resource Network deleted: d7f39628-666e-4480-8bee-49de183d5e09 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:39.740103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-1c31f77a-4cd0-4654-8832-ea81a00aca9b admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533'] for Network (d7f39628-666e-4480-8bee-49de183d5e09), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:40.266516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-9ed450cc-13ba-40ef-811d-b3521fdff06d admin admin] Resource SecurityGroup deleted: c2e0c046-51c9-480b-a3a5-5ef5152d3e20 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:40.267712 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-9ed450cc-13ba-40ef-811d-b3521fdff06d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (c2e0c046-51c9-480b-a3a5-5ef5152d3e20), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:40.268255 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ed450cc-13ba-40ef-811d-b3521fdff06d admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('c2e0c046-51c9-480b-a3a5-5ef5152d3e20',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:12:40.285668 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-9ed450cc-13ba-40ef-811d-b3521fdff06d admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('c2e0c046-51c9-480b-a3a5-5ef5152d3e20',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:12:40.286632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-9ed450cc-13ba-40ef-811d-b3521fdff06d admin admin] Resource SecurityGroupRule deleted: 16f515a0-eb55-4745-8585-e03f2631f7b2 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:40.287243 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-9ed450cc-13ba-40ef-811d-b3521fdff06d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (16f515a0-eb55-4745-8585-e03f2631f7b2), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:40.287762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-9ed450cc-13ba-40ef-811d-b3521fdff06d admin admin] Security group rule updated ['c2e0c046-51c9-480b-a3a5-5ef5152d3e20'] Sep 04 01:12:40.288249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-9ed450cc-13ba-40ef-811d-b3521fdff06d admin admin] Resource SecurityGroupRule deleted: 37b5ff1d-528c-40aa-b261-11fc8a2898f1 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:40.288678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-9ed450cc-13ba-40ef-811d-b3521fdff06d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (37b5ff1d-528c-40aa-b261-11fc8a2898f1), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:40.289249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-9ed450cc-13ba-40ef-811d-b3521fdff06d admin admin] Security group rule updated ['c2e0c046-51c9-480b-a3a5-5ef5152d3e20'] Sep 04 01:12:40.289887 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-9ed450cc-13ba-40ef-811d-b3521fdff06d admin admin] Resource SecurityGroupRule deleted: 4a262980-9824-4576-8271-d44359329c08 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:40.298563 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-9ed450cc-13ba-40ef-811d-b3521fdff06d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (4a262980-9824-4576-8271-d44359329c08), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:40.298563 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-9ed450cc-13ba-40ef-811d-b3521fdff06d admin admin] Security group rule updated ['c2e0c046-51c9-480b-a3a5-5ef5152d3e20'] Sep 04 01:12:40.298563 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-9ed450cc-13ba-40ef-811d-b3521fdff06d admin admin] Resource SecurityGroupRule deleted: 8633977c-c2b2-410f-9c6e-16f9bf70a2c7 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:40.298563 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-9ed450cc-13ba-40ef-811d-b3521fdff06d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (8633977c-c2b2-410f-9c6e-16f9bf70a2c7), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:40.298563 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-9ed450cc-13ba-40ef-811d-b3521fdff06d admin admin] Security group rule updated ['c2e0c046-51c9-480b-a3a5-5ef5152d3e20'] Sep 04 01:12:40.484692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:475 started Sep 04 01:12:40.488288 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade56fd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=880000000,duration_sec=969,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:12:40.488864 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:12:40.489303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:475 - starting polling. Elapsed:0.005 Sep 04 01:12:40.491339 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:40.496197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade56ff,OFPFlowMod(buffer_id=4294967295,command=3,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 11}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:12:40.496515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:475 - port information retrieved. Elapsed:0.012 Sep 04 01:12:40.496847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Starting to process devices in:{'current': {'c2f724af-5dbd-4d91-83cd-c5152b744599', 'da545e71-9e15-495e-b08a-2c36ede84742', '9db3ca9e-27d3-4852-b8c6-3fc745d2d055', '3fa24970-97a7-4f46-ac55-0b24323fa402', '89aa06b4-bbf1-40c2-bb48-500c3aecdf48', '68e4df44-e581-4fa1-922b-1b78021d5d7b', 'e507db86-47c3-4953-96bb-c5e552b4f602', '53e7a39c-e9ce-45c4-84af-632f2aac70ae', '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', 'b4f93563-ff7a-44c4-96a1-87f6e4348648', 'f0af75e4-63aa-44d3-bff7-973c3caf9bf9', '1cf499fb-10a0-4af2-afec-5f610dc85da6', 'ca102ce7-433c-4029-aabf-33d944165ff1'}, 'added': set(), 'removed': {'0a1a9f7e-73de-4620-ae03-4b1d50d7f706'}, 'updated': set(), 're_added': set()} {{(pid=107812) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 04 01:12:40.497200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:475 - agent port security group processed in 0.000 Sep 04 01:12:40.498938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Configuration for devices up [] and devices down [] completed. Sep 04 01:12:40.499408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for {'0a1a9f7e-73de-4620-ae03-4b1d50d7f706'} Sep 04 01:12:40.499845 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 4 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:12:40.541054 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[092855dd-eeed-4812-867b-6fd6f74c0c64]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:12:40.541682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Ports {'0a1a9f7e-73de-4620-ae03-4b1d50d7f706'} removed Sep 04 01:12:40.573818 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port removal failed for set() {{(pid=107812) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 04 01:12:40.574579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Reclaiming vlan = 6 from net-id = d7f39628-666e-4480-8bee-49de183d5e09, seg-id = 172 Sep 04 01:12:40.577148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x1fd38c07,OFPFlowMod(buffer_id=4294967295,command=3,cookie=6561907047025962751,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4102}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:12:40.579500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xeade5701,OFPFlowMod(buffer_id=4294967295,command=3,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4268}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:12:40.580114 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:475 - treat_devices_removed completed in 0.081 Sep 04 01:12:40.580405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:475 - ports processed. Elapsed:0.096 Sep 04 01:12:40.580731 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:475 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 1}}. Elapsed:0.096 Sep 04 01:12:41.957723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-05bf6a7e-2251-40c7-96d2-a1e646667dca tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Resource Port deleted: 19f203f1-14db-4bb0-aaad-c8e57c75d249 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:41.958839 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-05bf6a7e-2251-40c7-96d2-a1e646667dca tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (19f203f1-14db-4bb0-aaad-c8e57c75d249), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:41.960135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-05bf6a7e-2251-40c7-96d2-a1e646667dca tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Security group member updated {'5afa6b78-0b8f-45ce-ad51-9baae28be95f'} Sep 04 01:12:42.486177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:476 started Sep 04 01:12:42.493334 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5703,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=883000000,duration_sec=971,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:12:42.494777 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:12:42.495261 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:476 - starting polling. Elapsed:0.009 Sep 04 01:12:42.501373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:42.504201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 19f203f1-14db-4bb0-aaad-c8e57c75d249 not present in bridge br-int Sep 04 01:12:42.504860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] net_uuid None not managed by VLAN manager Sep 04 01:12:42.505318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for ['19f203f1-14db-4bb0-aaad-c8e57c75d249'] Sep 04 01:12:42.506736 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 19f203f1-14db-4bb0-aaad-c8e57c75d249 is not handled by the firewall. {{(pid=107812) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 04 01:12:42.513454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:476 - port information retrieved. Elapsed:0.023 Sep 04 01:12:42.513454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:476 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.024 Sep 04 01:12:44.486793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:477 started Sep 04 01:12:44.489785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5705,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=881000000,duration_sec=973,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:12:44.494906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:12:44.494906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:477 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:12:44.988362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-530ed0cb-3c07-4b9b-9346-544092c99402 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:12:44Z,description='Default security group',id=41f1a042-1c8a-4a67-a37c-51f199d29122,is_default=True,name='default',project_id='e67874d0fb224e80a4fb66434a4c2db8',revision_number=1,rules=[SecurityGroupRule(0e842787-27ee-466a-8343-54ab2d71c65f),SecurityGroupRule(571c3b4f-0e13-4b1b-b7e9-6363062c92a1),SecurityGroupRule(5da68ccb-c43a-447a-b7e0-f26ee159f371),SecurityGroupRule(d1256de9-84ee-48b9-bf64-6700c02604c1)],shared=False,stateful=True,updated_at=2022-09-04T01:12:44Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:44.988973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-530ed0cb-3c07-4b9b-9346-544092c99402 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (41f1a042-1c8a-4a67-a37c-51f199d29122), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:44.992485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-530ed0cb-3c07-4b9b-9346-544092c99402 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:12:44Z,description=,direction='egress',ethertype='IPv4',id=0e842787-27ee-466a-8343-54ab2d71c65f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e67874d0fb224e80a4fb66434a4c2db8',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=41f1a042-1c8a-4a67-a37c-51f199d29122,updated_at=2022-09-04T01:12:44Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:44.992485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-530ed0cb-3c07-4b9b-9346-544092c99402 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (0e842787-27ee-466a-8343-54ab2d71c65f), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:44.992485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-530ed0cb-3c07-4b9b-9346-544092c99402 admin admin] Security group rule updated ['41f1a042-1c8a-4a67-a37c-51f199d29122'] Sep 04 01:12:44.992907 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-530ed0cb-3c07-4b9b-9346-544092c99402 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:12:44Z,description=,direction='ingress',ethertype='IPv4',id=571c3b4f-0e13-4b1b-b7e9-6363062c92a1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e67874d0fb224e80a4fb66434a4c2db8',protocol=,remote_address_group_id=,remote_group_id=41f1a042-1c8a-4a67-a37c-51f199d29122,remote_ip_prefix=,revision_number=0,security_group_id=41f1a042-1c8a-4a67-a37c-51f199d29122,updated_at=2022-09-04T01:12:44Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:44.992907 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-530ed0cb-3c07-4b9b-9346-544092c99402 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (571c3b4f-0e13-4b1b-b7e9-6363062c92a1), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:44.992907 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-530ed0cb-3c07-4b9b-9346-544092c99402 admin admin] Security group rule updated ['41f1a042-1c8a-4a67-a37c-51f199d29122'] Sep 04 01:12:44.993203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-530ed0cb-3c07-4b9b-9346-544092c99402 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:12:44Z,description=,direction='egress',ethertype='IPv6',id=5da68ccb-c43a-447a-b7e0-f26ee159f371,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e67874d0fb224e80a4fb66434a4c2db8',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=41f1a042-1c8a-4a67-a37c-51f199d29122,updated_at=2022-09-04T01:12:44Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:44.993484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-530ed0cb-3c07-4b9b-9346-544092c99402 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (5da68ccb-c43a-447a-b7e0-f26ee159f371), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:44.994004 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-530ed0cb-3c07-4b9b-9346-544092c99402 admin admin] Security group rule updated ['41f1a042-1c8a-4a67-a37c-51f199d29122'] Sep 04 01:12:44.995028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-530ed0cb-3c07-4b9b-9346-544092c99402 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:12:44Z,description=,direction='ingress',ethertype='IPv6',id=d1256de9-84ee-48b9-bf64-6700c02604c1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e67874d0fb224e80a4fb66434a4c2db8',protocol=,remote_address_group_id=,remote_group_id=41f1a042-1c8a-4a67-a37c-51f199d29122,remote_ip_prefix=,revision_number=0,security_group_id=41f1a042-1c8a-4a67-a37c-51f199d29122,updated_at=2022-09-04T01:12:44Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:44.995351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-530ed0cb-3c07-4b9b-9346-544092c99402 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (d1256de9-84ee-48b9-bf64-6700c02604c1), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:44.995747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-530ed0cb-3c07-4b9b-9346-544092c99402 admin admin] Security group rule updated ['41f1a042-1c8a-4a67-a37c-51f199d29122'] Sep 04 01:12:45.012096 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-adff139d-e342-4863-92ae-354a54bb7f2b tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Resource SecurityGroup deleted: 5afa6b78-0b8f-45ce-ad51-9baae28be95f {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:45.012648 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-adff139d-e342-4863-92ae-354a54bb7f2b tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (5afa6b78-0b8f-45ce-ad51-9baae28be95f), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:45.013375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-adff139d-e342-4863-92ae-354a54bb7f2b tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('5afa6b78-0b8f-45ce-ad51-9baae28be95f',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:12:45.029517 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-adff139d-e342-4863-92ae-354a54bb7f2b tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('5afa6b78-0b8f-45ce-ad51-9baae28be95f',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:12:45.030202 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-adff139d-e342-4863-92ae-354a54bb7f2b tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Resource SecurityGroupRule deleted: 32f68641-b96f-455c-8dc7-3bb02423a062 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:45.030665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-adff139d-e342-4863-92ae-354a54bb7f2b tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (32f68641-b96f-455c-8dc7-3bb02423a062), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:45.031095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-adff139d-e342-4863-92ae-354a54bb7f2b tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Security group rule updated ['5afa6b78-0b8f-45ce-ad51-9baae28be95f'] Sep 04 01:12:45.031627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-adff139d-e342-4863-92ae-354a54bb7f2b tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Resource SecurityGroupRule deleted: c0a0377d-abf2-4cdd-8af3-883268f42bc7 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:45.032599 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-adff139d-e342-4863-92ae-354a54bb7f2b tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (c0a0377d-abf2-4cdd-8af3-883268f42bc7), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:45.033147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-adff139d-e342-4863-92ae-354a54bb7f2b tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Security group rule updated ['5afa6b78-0b8f-45ce-ad51-9baae28be95f'] Sep 04 01:12:45.033811 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-adff139d-e342-4863-92ae-354a54bb7f2b tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Resource SecurityGroupRule deleted: 4de458ba-1eb5-4dd5-841d-d9e7c68344cc {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:45.034393 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-adff139d-e342-4863-92ae-354a54bb7f2b tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (4de458ba-1eb5-4dd5-841d-d9e7c68344cc), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:45.034814 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-adff139d-e342-4863-92ae-354a54bb7f2b tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Security group rule updated ['5afa6b78-0b8f-45ce-ad51-9baae28be95f'] Sep 04 01:12:45.035342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-adff139d-e342-4863-92ae-354a54bb7f2b tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Resource SecurityGroupRule deleted: 7525c5fa-e43a-4f26-b2c1-bfe4a23faa11 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:45.035841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-adff139d-e342-4863-92ae-354a54bb7f2b tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (7525c5fa-e43a-4f26-b2c1-bfe4a23faa11), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:45.036257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-adff139d-e342-4863-92ae-354a54bb7f2b tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Security group rule updated ['5afa6b78-0b8f-45ce-ad51-9baae28be95f'] Sep 04 01:12:45.194646 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-96d8dcbe-82fa-4a39-a8eb-caeeae882bbf admin admin] Resource SecurityGroup deleted: 41f1a042-1c8a-4a67-a37c-51f199d29122 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:45.195348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-96d8dcbe-82fa-4a39-a8eb-caeeae882bbf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (41f1a042-1c8a-4a67-a37c-51f199d29122), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:45.196087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96d8dcbe-82fa-4a39-a8eb-caeeae882bbf admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('41f1a042-1c8a-4a67-a37c-51f199d29122',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:12:45.210635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-96d8dcbe-82fa-4a39-a8eb-caeeae882bbf admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('41f1a042-1c8a-4a67-a37c-51f199d29122',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:12:45.211144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-96d8dcbe-82fa-4a39-a8eb-caeeae882bbf admin admin] Resource SecurityGroupRule deleted: 0e842787-27ee-466a-8343-54ab2d71c65f {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:45.211676 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-96d8dcbe-82fa-4a39-a8eb-caeeae882bbf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (0e842787-27ee-466a-8343-54ab2d71c65f), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:45.212175 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-96d8dcbe-82fa-4a39-a8eb-caeeae882bbf admin admin] Security group rule updated ['41f1a042-1c8a-4a67-a37c-51f199d29122'] Sep 04 01:12:45.212621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-96d8dcbe-82fa-4a39-a8eb-caeeae882bbf admin admin] Resource SecurityGroupRule deleted: 571c3b4f-0e13-4b1b-b7e9-6363062c92a1 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:45.213089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-96d8dcbe-82fa-4a39-a8eb-caeeae882bbf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (571c3b4f-0e13-4b1b-b7e9-6363062c92a1), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:45.213447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-96d8dcbe-82fa-4a39-a8eb-caeeae882bbf admin admin] Security group rule updated ['41f1a042-1c8a-4a67-a37c-51f199d29122'] Sep 04 01:12:45.213867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-96d8dcbe-82fa-4a39-a8eb-caeeae882bbf admin admin] Resource SecurityGroupRule deleted: 5da68ccb-c43a-447a-b7e0-f26ee159f371 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:45.214222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-96d8dcbe-82fa-4a39-a8eb-caeeae882bbf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (5da68ccb-c43a-447a-b7e0-f26ee159f371), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:45.214540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-96d8dcbe-82fa-4a39-a8eb-caeeae882bbf admin admin] Security group rule updated ['41f1a042-1c8a-4a67-a37c-51f199d29122'] Sep 04 01:12:45.214954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-96d8dcbe-82fa-4a39-a8eb-caeeae882bbf admin admin] Resource SecurityGroupRule deleted: d1256de9-84ee-48b9-bf64-6700c02604c1 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:45.215551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-96d8dcbe-82fa-4a39-a8eb-caeeae882bbf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (d1256de9-84ee-48b9-bf64-6700c02604c1), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:45.216386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-96d8dcbe-82fa-4a39-a8eb-caeeae882bbf admin admin] Security group rule updated ['41f1a042-1c8a-4a67-a37c-51f199d29122'] Sep 04 01:12:45.467325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-8c1087e6-ceea-4ce0-8965-3764867aeaf2 tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Resource Port deleted: b89e971b-9f65-44f6-966c-0d2c99d71723 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:45.467433 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-8c1087e6-ceea-4ce0-8965-3764867aeaf2 tempest-AttachVolumeShelveTestJSON-1588860844 tempest-AttachVolumeShelveTestJSON-1588860844-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (b89e971b-9f65-44f6-966c-0d2c99d71723), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:45.982774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-a3ba0b41-cb7c-47d6-9029-8e12e845c73d admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:12:45Z,description='Default security group',id=80478b44-b66b-4c61-8d87-1b6d40338012,is_default=True,name='default',project_id='77465baf5a44483d9df1d4c901c0cfd4',revision_number=1,rules=[SecurityGroupRule(69904cc9-7f29-437f-91d6-b3a86759bd64),SecurityGroupRule(98cc5671-5393-4508-a247-9d6e52890b37),SecurityGroupRule(a4325eec-db6c-4489-baf5-ce25d17bccfb),SecurityGroupRule(e1aebc7e-0223-43fc-81e2-dd9da32750ab)],shared=False,stateful=True,updated_at=2022-09-04T01:12:45Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:45.983476 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-a3ba0b41-cb7c-47d6-9029-8e12e845c73d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (80478b44-b66b-4c61-8d87-1b6d40338012), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:45.983785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-a3ba0b41-cb7c-47d6-9029-8e12e845c73d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:12:45Z,description=,direction='egress',ethertype='IPv4',id=69904cc9-7f29-437f-91d6-b3a86759bd64,normalized_cidr=None,port_range_max=,port_range_min=,project_id='77465baf5a44483d9df1d4c901c0cfd4',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=80478b44-b66b-4c61-8d87-1b6d40338012,updated_at=2022-09-04T01:12:45Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:45.984329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-a3ba0b41-cb7c-47d6-9029-8e12e845c73d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (69904cc9-7f29-437f-91d6-b3a86759bd64), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:45.984813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-a3ba0b41-cb7c-47d6-9029-8e12e845c73d admin admin] Security group rule updated ['80478b44-b66b-4c61-8d87-1b6d40338012'] Sep 04 01:12:45.985761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-a3ba0b41-cb7c-47d6-9029-8e12e845c73d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:12:45Z,description=,direction='ingress',ethertype='IPv4',id=98cc5671-5393-4508-a247-9d6e52890b37,normalized_cidr=None,port_range_max=,port_range_min=,project_id='77465baf5a44483d9df1d4c901c0cfd4',protocol=,remote_address_group_id=,remote_group_id=80478b44-b66b-4c61-8d87-1b6d40338012,remote_ip_prefix=,revision_number=0,security_group_id=80478b44-b66b-4c61-8d87-1b6d40338012,updated_at=2022-09-04T01:12:45Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:45.986112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-a3ba0b41-cb7c-47d6-9029-8e12e845c73d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (98cc5671-5393-4508-a247-9d6e52890b37), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:45.986437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-a3ba0b41-cb7c-47d6-9029-8e12e845c73d admin admin] Security group rule updated ['80478b44-b66b-4c61-8d87-1b6d40338012'] Sep 04 01:12:45.987670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-a3ba0b41-cb7c-47d6-9029-8e12e845c73d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:12:45Z,description=,direction='ingress',ethertype='IPv6',id=a4325eec-db6c-4489-baf5-ce25d17bccfb,normalized_cidr=None,port_range_max=,port_range_min=,project_id='77465baf5a44483d9df1d4c901c0cfd4',protocol=,remote_address_group_id=,remote_group_id=80478b44-b66b-4c61-8d87-1b6d40338012,remote_ip_prefix=,revision_number=0,security_group_id=80478b44-b66b-4c61-8d87-1b6d40338012,updated_at=2022-09-04T01:12:45Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:45.988022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-a3ba0b41-cb7c-47d6-9029-8e12e845c73d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (a4325eec-db6c-4489-baf5-ce25d17bccfb), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:45.991842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-a3ba0b41-cb7c-47d6-9029-8e12e845c73d admin admin] Security group rule updated ['80478b44-b66b-4c61-8d87-1b6d40338012'] Sep 04 01:12:45.991842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-a3ba0b41-cb7c-47d6-9029-8e12e845c73d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:12:45Z,description=,direction='egress',ethertype='IPv6',id=e1aebc7e-0223-43fc-81e2-dd9da32750ab,normalized_cidr=None,port_range_max=,port_range_min=,project_id='77465baf5a44483d9df1d4c901c0cfd4',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=80478b44-b66b-4c61-8d87-1b6d40338012,updated_at=2022-09-04T01:12:45Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:45.991842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-a3ba0b41-cb7c-47d6-9029-8e12e845c73d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (e1aebc7e-0223-43fc-81e2-dd9da32750ab), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:45.991842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-a3ba0b41-cb7c-47d6-9029-8e12e845c73d admin admin] Security group rule updated ['80478b44-b66b-4c61-8d87-1b6d40338012'] Sep 04 01:12:46.185173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-cca1739d-9fe8-4931-a740-b06212c56d3d admin admin] Resource SecurityGroup deleted: 80478b44-b66b-4c61-8d87-1b6d40338012 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:46.185584 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-cca1739d-9fe8-4931-a740-b06212c56d3d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (80478b44-b66b-4c61-8d87-1b6d40338012), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:46.186494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cca1739d-9fe8-4931-a740-b06212c56d3d admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('80478b44-b66b-4c61-8d87-1b6d40338012',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:12:46.201801 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-cca1739d-9fe8-4931-a740-b06212c56d3d admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('80478b44-b66b-4c61-8d87-1b6d40338012',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:12:46.202259 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-cca1739d-9fe8-4931-a740-b06212c56d3d admin admin] Resource SecurityGroupRule deleted: 69904cc9-7f29-437f-91d6-b3a86759bd64 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:46.202965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-cca1739d-9fe8-4931-a740-b06212c56d3d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (69904cc9-7f29-437f-91d6-b3a86759bd64), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:46.203495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-cca1739d-9fe8-4931-a740-b06212c56d3d admin admin] Security group rule updated ['80478b44-b66b-4c61-8d87-1b6d40338012'] Sep 04 01:12:46.203938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-cca1739d-9fe8-4931-a740-b06212c56d3d admin admin] Resource SecurityGroupRule deleted: 98cc5671-5393-4508-a247-9d6e52890b37 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:46.204286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-cca1739d-9fe8-4931-a740-b06212c56d3d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (98cc5671-5393-4508-a247-9d6e52890b37), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:46.204607 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-cca1739d-9fe8-4931-a740-b06212c56d3d admin admin] Security group rule updated ['80478b44-b66b-4c61-8d87-1b6d40338012'] Sep 04 01:12:46.205022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-cca1739d-9fe8-4931-a740-b06212c56d3d admin admin] Resource SecurityGroupRule deleted: a4325eec-db6c-4489-baf5-ce25d17bccfb {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:46.205631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-cca1739d-9fe8-4931-a740-b06212c56d3d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (a4325eec-db6c-4489-baf5-ce25d17bccfb), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:46.206074 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-cca1739d-9fe8-4931-a740-b06212c56d3d admin admin] Security group rule updated ['80478b44-b66b-4c61-8d87-1b6d40338012'] Sep 04 01:12:46.206594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-cca1739d-9fe8-4931-a740-b06212c56d3d admin admin] Resource SecurityGroupRule deleted: e1aebc7e-0223-43fc-81e2-dd9da32750ab {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:46.206988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-cca1739d-9fe8-4931-a740-b06212c56d3d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (e1aebc7e-0223-43fc-81e2-dd9da32750ab), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:46.207307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-cca1739d-9fe8-4931-a740-b06212c56d3d admin admin] Security group rule updated ['80478b44-b66b-4c61-8d87-1b6d40338012'] Sep 04 01:12:46.488024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:478 started Sep 04 01:12:46.490784 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5707,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=882000000,duration_sec=975,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:12:46.491357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:12:46.491950 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:478 - starting polling. Elapsed:0.004 Sep 04 01:12:46.494021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:46.495382 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port b89e971b-9f65-44f6-966c-0d2c99d71723 not present in bridge br-int Sep 04 01:12:46.503977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] net_uuid None not managed by VLAN manager Sep 04 01:12:46.503977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for ['b89e971b-9f65-44f6-966c-0d2c99d71723'] Sep 04 01:12:46.503977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port b89e971b-9f65-44f6-966c-0d2c99d71723 is not handled by the firewall. {{(pid=107812) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 04 01:12:46.503977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:478 - port information retrieved. Elapsed:0.011 Sep 04 01:12:46.503977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:478 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 04 01:12:48.488697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:479 started Sep 04 01:12:48.491232 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5709,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=883000000,duration_sec=977,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:12:48.492051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:12:48.492398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:479 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:12:50.489598 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:480 started Sep 04 01:12:50.492430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade570b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=884000000,duration_sec=979,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:12:50.493002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:12:50.493448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:480 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:12:52.436714 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-8f194a76-3043-4f79-b861-3aae587658ab admin admin] Resource Port deleted: c2f724af-5dbd-4d91-83cd-c5152b744599 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:52.437389 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-8f194a76-3043-4f79-b861-3aae587658ab admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (c2f724af-5dbd-4d91-83cd-c5152b744599), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:52.490773 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:481 started Sep 04 01:12:52.494101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade570d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=885000000,duration_sec=981,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:12:52.494738 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:12:52.495152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:481 - starting polling. Elapsed:0.005 Sep 04 01:12:52.497734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:52.500772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-c2f724af-5d, col_values=(('tag', 4095),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:12:52.509923 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade570f,OFPFlowMod(buffer_id=4294967295,command=0,cookie=6887031442322345889,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 18}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:12:52.510383 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for ['c2f724af-5dbd-4d91-83cd-c5152b744599'] Sep 04 01:12:52.511068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 4 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:12:52.562533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe97bd9f-2d91-4fdb-b2d8-cee6356d30b7]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:12:52.565738 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:481 - port information retrieved. Elapsed:0.075 Sep 04 01:12:52.566161 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:481 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.076 Sep 04 01:12:53.428278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["3f1c4103-9a56-464a-8fe0-0830743bb384","delete","qr-c2f724af-5d",18,["map",[["attached-mac","fa:16:3e:fb:1a:e1"],["iface-id","c2f724af-5dbd-4d91-83cd-c5152b744599"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:12:53.548279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-aa5994a5-5bed-4aae-9c49-5f0654e5073e admin admin] Resource Port deleted: 1cf499fb-10a0-4af2-afec-5f610dc85da6 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:53.549299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-aa5994a5-5bed-4aae-9c49-5f0654e5073e admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (1cf499fb-10a0-4af2-afec-5f610dc85da6), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:53.819811 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["59dff06f-11d0-4303-a7d7-9efc16a26866","delete","qg-1cf499fb-10",12,["map",[["attached-mac","fa:16:3e:8a:3e:25"],["iface-id","1cf499fb-10a0-4af2-afec-5f610dc85da6"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:12:54.180429 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-ccd2a674-8f76-4d44-b193-e603d27b1a21 admin admin] Resource Subnet deleted: b8f8e824-5e09-4bb6-bfba-faf43aae1f44 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:54.184940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-ccd2a674-8f76-4d44-b193-e603d27b1a21 admin admin] Publish callbacks [] for Subnet (b8f8e824-5e09-4bb6-bfba-faf43aae1f44), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:54.311637 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["3ea6bfd3-f140-4cd5-89e2-21ab81396b7c","delete","tap53e7a39c-e9",7,["map",[["attached-mac","fa:16:3e:f4:97:c5"],["iface-id","53e7a39c-e9ce-45c4-84af-632f2aac70ae"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:12:54.491660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:482 started Sep 04 01:12:54.494560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5711,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=886000000,duration_sec=983,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:12:54.495131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:12:54.495611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:482 - starting polling. Elapsed:0.004 Sep 04 01:12:54.497585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:54.501447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade5713,OFPFlowMod(buffer_id=4294967295,command=3,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 18}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:12:54.503942 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade5715,OFPFlowMod(buffer_id=4294967295,command=3,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 12}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:12:54.505447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade5717,OFPFlowMod(buffer_id=4294967295,command=3,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 7}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:12:54.505749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:482 - port information retrieved. Elapsed:0.014 Sep 04 01:12:54.506081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Starting to process devices in:{'current': {'da545e71-9e15-495e-b08a-2c36ede84742', '9db3ca9e-27d3-4852-b8c6-3fc745d2d055', '3fa24970-97a7-4f46-ac55-0b24323fa402', '89aa06b4-bbf1-40c2-bb48-500c3aecdf48', '68e4df44-e581-4fa1-922b-1b78021d5d7b', 'e507db86-47c3-4953-96bb-c5e552b4f602', '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', 'b4f93563-ff7a-44c4-96a1-87f6e4348648', 'f0af75e4-63aa-44d3-bff7-973c3caf9bf9', 'ca102ce7-433c-4029-aabf-33d944165ff1'}, 'added': set(), 'removed': {'c2f724af-5dbd-4d91-83cd-c5152b744599', '1cf499fb-10a0-4af2-afec-5f610dc85da6', '53e7a39c-e9ce-45c4-84af-632f2aac70ae'}, 'updated': set(), 're_added': set()} {{(pid=107812) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 04 01:12:54.506630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:482 - agent port security group processed in 0.000 Sep 04 01:12:54.508123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Configuration for devices up [] and devices down [] completed. Sep 04 01:12:54.508426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for {'c2f724af-5dbd-4d91-83cd-c5152b744599', '1cf499fb-10a0-4af2-afec-5f610dc85da6', '53e7a39c-e9ce-45c4-84af-632f2aac70ae'} Sep 04 01:12:54.508753 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port c2f724af-5dbd-4d91-83cd-c5152b744599 is not handled by the firewall. {{(pid=107812) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 04 01:12:54.509255 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 8 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:12:54.548171 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b748494-29a4-4106-a9f7-c64851bc007c]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:12:54.548849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Ports {'c2f724af-5dbd-4d91-83cd-c5152b744599', '1cf499fb-10a0-4af2-afec-5f610dc85da6', '53e7a39c-e9ce-45c4-84af-632f2aac70ae'} removed Sep 04 01:12:54.613636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-92caa402-4ac0-45ed-82c9-bc914705f15e admin admin] Resource Port deleted: 53e7a39c-e9ce-45c4-84af-632f2aac70ae {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:54.614642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-92caa402-4ac0-45ed-82c9-bc914705f15e admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (53e7a39c-e9ce-45c4-84af-632f2aac70ae), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:54.622521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port removal failed for set() {{(pid=107812) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 04 01:12:54.622956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] net_uuid None not managed by VLAN manager Sep 04 01:12:54.623581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Reclaiming vlan = 5 from net-id = 3e702e6e-ebe1-46a7-b30d-f3d140ac2993, seg-id = 167 Sep 04 01:12:54.627988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x1fd38c09,OFPFlowMod(buffer_id=4294967295,command=3,cookie=6561907047025962751,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4101}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:12:54.635513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xeade5719,OFPFlowMod(buffer_id=4294967295,command=3,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4263}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:12:54.635513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:482 - treat_devices_removed completed in 0.123 Sep 04 01:12:54.635513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:482 - ports processed. Elapsed:0.140 Sep 04 01:12:54.635513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:482 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 3}}. Elapsed:0.141 Sep 04 01:12:54.647824 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-94e8d5be-5816-4775-a879-fda5fd84bf56 None None] Resource Port deleted: 53e7a39c-e9ce-45c4-84af-632f2aac70ae {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:54.647997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-94e8d5be-5816-4775-a879-fda5fd84bf56 None None] Skipped duplicate delete event for 53e7a39c-e9ce-45c4-84af-632f2aac70ae {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:209}} Sep 04 01:12:54.947742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-92caa402-4ac0-45ed-82c9-bc914705f15e admin admin] Resource Network deleted: 3e702e6e-ebe1-46a7-b30d-f3d140ac2993 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:54.955937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-92caa402-4ac0-45ed-82c9-bc914705f15e admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533'] for Network (3e702e6e-ebe1-46a7-b30d-f3d140ac2993), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:55.522335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-ab9e12f0-09a3-4436-8ed4-3197a94fb1cd admin admin] Resource SecurityGroup deleted: 421f3fc5-37dd-45fe-9d09-0151fc3a66b2 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:55.522746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-ab9e12f0-09a3-4436-8ed4-3197a94fb1cd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (421f3fc5-37dd-45fe-9d09-0151fc3a66b2), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:55.523216 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab9e12f0-09a3-4436-8ed4-3197a94fb1cd admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('421f3fc5-37dd-45fe-9d09-0151fc3a66b2',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:12:55.536493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-ab9e12f0-09a3-4436-8ed4-3197a94fb1cd admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('421f3fc5-37dd-45fe-9d09-0151fc3a66b2',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:12:55.536934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-ab9e12f0-09a3-4436-8ed4-3197a94fb1cd admin admin] Resource SecurityGroupRule deleted: 416a0bfa-f39b-4e3c-967d-d5929230a9c9 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:55.537337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-ab9e12f0-09a3-4436-8ed4-3197a94fb1cd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (416a0bfa-f39b-4e3c-967d-d5929230a9c9), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:55.537675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-ab9e12f0-09a3-4436-8ed4-3197a94fb1cd admin admin] Security group rule updated ['421f3fc5-37dd-45fe-9d09-0151fc3a66b2'] Sep 04 01:12:55.538139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-ab9e12f0-09a3-4436-8ed4-3197a94fb1cd admin admin] Resource SecurityGroupRule deleted: 4294e6e8-5268-4fa8-ba5a-cd3d69e46403 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:55.538491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-ab9e12f0-09a3-4436-8ed4-3197a94fb1cd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (4294e6e8-5268-4fa8-ba5a-cd3d69e46403), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:55.538810 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-ab9e12f0-09a3-4436-8ed4-3197a94fb1cd admin admin] Security group rule updated ['421f3fc5-37dd-45fe-9d09-0151fc3a66b2'] Sep 04 01:12:55.539224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-ab9e12f0-09a3-4436-8ed4-3197a94fb1cd admin admin] Resource SecurityGroupRule deleted: 765e4f1c-9b1d-4ac6-9b58-b6786c5fb728 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:55.539768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-ab9e12f0-09a3-4436-8ed4-3197a94fb1cd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (765e4f1c-9b1d-4ac6-9b58-b6786c5fb728), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:55.540290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-ab9e12f0-09a3-4436-8ed4-3197a94fb1cd admin admin] Security group rule updated ['421f3fc5-37dd-45fe-9d09-0151fc3a66b2'] Sep 04 01:12:55.540717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-ab9e12f0-09a3-4436-8ed4-3197a94fb1cd admin admin] Resource SecurityGroupRule deleted: 83eeee27-d67e-43b3-9d4c-1fdbc220c340 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:55.541059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-ab9e12f0-09a3-4436-8ed4-3197a94fb1cd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (83eeee27-d67e-43b3-9d4c-1fdbc220c340), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:55.541414 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-ab9e12f0-09a3-4436-8ed4-3197a94fb1cd admin admin] Security group rule updated ['421f3fc5-37dd-45fe-9d09-0151fc3a66b2'] Sep 04 01:12:56.494860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:483 started Sep 04 01:12:56.495439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade571b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=887000000,duration_sec=985,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:12:56.495815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:12:56.496146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:483 - starting polling. Elapsed:0.004 Sep 04 01:12:56.497925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:56.499264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 53e7a39c-e9ce-45c4-84af-632f2aac70ae not present in bridge br-int Sep 04 01:12:56.499597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] net_uuid None not managed by VLAN manager Sep 04 01:12:56.499879 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for ['53e7a39c-e9ce-45c4-84af-632f2aac70ae'] Sep 04 01:12:56.500198 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 53e7a39c-e9ce-45c4-84af-632f2aac70ae is not handled by the firewall. {{(pid=107812) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 04 01:12:56.502519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:483 - port information retrieved. Elapsed:0.010 Sep 04 01:12:56.502850 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:483 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Sep 04 01:12:58.494575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:484 started Sep 04 01:12:58.497196 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade571d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=889000000,duration_sec=987,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:12:58.497890 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:12:58.498254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:484 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:12:58.694376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4d62f3ea-2889-459d-b88e-2a2c6e1e9d7f admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:12:58Z,description='Default security group',id=e49ddbb6-77bb-486a-970b-c5ca745f37b8,is_default=True,name='default',project_id='0a46e1b837a14345b3d11969f64f3dae',revision_number=1,rules=[SecurityGroupRule(982d2690-fbec-4d2d-863b-b6a72b1592f8),SecurityGroupRule(a536c576-63f9-49bf-b8a5-4d36b7d500af),SecurityGroupRule(c59e797e-c9ff-416d-a735-7b9ae722c06c),SecurityGroupRule(eb530360-bfb3-467f-a987-8028f439f4d2)],shared=False,stateful=True,updated_at=2022-09-04T01:12:58Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:58.694755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4d62f3ea-2889-459d-b88e-2a2c6e1e9d7f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (e49ddbb6-77bb-486a-970b-c5ca745f37b8), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:58.695388 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4d62f3ea-2889-459d-b88e-2a2c6e1e9d7f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:12:58Z,description=,direction='egress',ethertype='IPv4',id=982d2690-fbec-4d2d-863b-b6a72b1592f8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0a46e1b837a14345b3d11969f64f3dae',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e49ddbb6-77bb-486a-970b-c5ca745f37b8,updated_at=2022-09-04T01:12:58Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:58.695756 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4d62f3ea-2889-459d-b88e-2a2c6e1e9d7f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (982d2690-fbec-4d2d-863b-b6a72b1592f8), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:58.696157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-4d62f3ea-2889-459d-b88e-2a2c6e1e9d7f admin admin] Security group rule updated ['e49ddbb6-77bb-486a-970b-c5ca745f37b8'] Sep 04 01:12:58.697113 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4d62f3ea-2889-459d-b88e-2a2c6e1e9d7f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:12:58Z,description=,direction='egress',ethertype='IPv6',id=a536c576-63f9-49bf-b8a5-4d36b7d500af,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0a46e1b837a14345b3d11969f64f3dae',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e49ddbb6-77bb-486a-970b-c5ca745f37b8,updated_at=2022-09-04T01:12:58Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:58.697470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4d62f3ea-2889-459d-b88e-2a2c6e1e9d7f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (a536c576-63f9-49bf-b8a5-4d36b7d500af), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:58.697844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-4d62f3ea-2889-459d-b88e-2a2c6e1e9d7f admin admin] Security group rule updated ['e49ddbb6-77bb-486a-970b-c5ca745f37b8'] Sep 04 01:12:58.698726 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4d62f3ea-2889-459d-b88e-2a2c6e1e9d7f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:12:58Z,description=,direction='ingress',ethertype='IPv4',id=c59e797e-c9ff-416d-a735-7b9ae722c06c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0a46e1b837a14345b3d11969f64f3dae',protocol=,remote_address_group_id=,remote_group_id=e49ddbb6-77bb-486a-970b-c5ca745f37b8,remote_ip_prefix=,revision_number=0,security_group_id=e49ddbb6-77bb-486a-970b-c5ca745f37b8,updated_at=2022-09-04T01:12:58Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:58.698968 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4d62f3ea-2889-459d-b88e-2a2c6e1e9d7f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (c59e797e-c9ff-416d-a735-7b9ae722c06c), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:58.699269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-4d62f3ea-2889-459d-b88e-2a2c6e1e9d7f admin admin] Security group rule updated ['e49ddbb6-77bb-486a-970b-c5ca745f37b8'] Sep 04 01:12:58.700047 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4d62f3ea-2889-459d-b88e-2a2c6e1e9d7f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:12:58Z,description=,direction='ingress',ethertype='IPv6',id=eb530360-bfb3-467f-a987-8028f439f4d2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0a46e1b837a14345b3d11969f64f3dae',protocol=,remote_address_group_id=,remote_group_id=e49ddbb6-77bb-486a-970b-c5ca745f37b8,remote_ip_prefix=,revision_number=0,security_group_id=e49ddbb6-77bb-486a-970b-c5ca745f37b8,updated_at=2022-09-04T01:12:58Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:12:58.700402 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4d62f3ea-2889-459d-b88e-2a2c6e1e9d7f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (eb530360-bfb3-467f-a987-8028f439f4d2), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:58.700735 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-4d62f3ea-2889-459d-b88e-2a2c6e1e9d7f admin admin] Security group rule updated ['e49ddbb6-77bb-486a-970b-c5ca745f37b8'] Sep 04 01:12:59.174637 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-8190ebca-d738-4b13-8b0b-523aee85a105 admin admin] Resource SecurityGroup deleted: e49ddbb6-77bb-486a-970b-c5ca745f37b8 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:59.175414 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-8190ebca-d738-4b13-8b0b-523aee85a105 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (e49ddbb6-77bb-486a-970b-c5ca745f37b8), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:59.176009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8190ebca-d738-4b13-8b0b-523aee85a105 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('e49ddbb6-77bb-486a-970b-c5ca745f37b8',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:12:59.189409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-8190ebca-d738-4b13-8b0b-523aee85a105 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('e49ddbb6-77bb-486a-970b-c5ca745f37b8',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:12:59.208144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-8190ebca-d738-4b13-8b0b-523aee85a105 admin admin] Resource SecurityGroupRule deleted: 982d2690-fbec-4d2d-863b-b6a72b1592f8 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:59.208144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-8190ebca-d738-4b13-8b0b-523aee85a105 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (982d2690-fbec-4d2d-863b-b6a72b1592f8), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:59.208144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-8190ebca-d738-4b13-8b0b-523aee85a105 admin admin] Security group rule updated ['e49ddbb6-77bb-486a-970b-c5ca745f37b8'] Sep 04 01:12:59.208144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-8190ebca-d738-4b13-8b0b-523aee85a105 admin admin] Resource SecurityGroupRule deleted: a536c576-63f9-49bf-b8a5-4d36b7d500af {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:59.208144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-8190ebca-d738-4b13-8b0b-523aee85a105 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (a536c576-63f9-49bf-b8a5-4d36b7d500af), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:59.208888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-8190ebca-d738-4b13-8b0b-523aee85a105 admin admin] Security group rule updated ['e49ddbb6-77bb-486a-970b-c5ca745f37b8'] Sep 04 01:12:59.208888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-8190ebca-d738-4b13-8b0b-523aee85a105 admin admin] Resource SecurityGroupRule deleted: c59e797e-c9ff-416d-a735-7b9ae722c06c {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:59.208888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-8190ebca-d738-4b13-8b0b-523aee85a105 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (c59e797e-c9ff-416d-a735-7b9ae722c06c), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:59.208888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-8190ebca-d738-4b13-8b0b-523aee85a105 admin admin] Security group rule updated ['e49ddbb6-77bb-486a-970b-c5ca745f37b8'] Sep 04 01:12:59.208888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-8190ebca-d738-4b13-8b0b-523aee85a105 admin admin] Resource SecurityGroupRule deleted: eb530360-bfb3-467f-a987-8028f439f4d2 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:12:59.209376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-8190ebca-d738-4b13-8b0b-523aee85a105 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (eb530360-bfb3-467f-a987-8028f439f4d2), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:12:59.209376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-8190ebca-d738-4b13-8b0b-523aee85a105 admin admin] Security group rule updated ['e49ddbb6-77bb-486a-970b-c5ca745f37b8'] Sep 04 01:13:00.115320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-d0c4f950-c627-41bc-82d5-5574e1c9e75c admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:12:59Z,description='Default security group',id=cb7bdb01-481f-49db-b508-78671b73e42e,is_default=True,name='default',project_id='fdb2b7eabf214f66a355bd53eebdb9f5',revision_number=1,rules=[SecurityGroupRule(0e378931-7fb4-4a1f-b732-3941ef7a5f0b),SecurityGroupRule(5a155d9b-64cc-45a8-b4bc-7f304cd02c78),SecurityGroupRule(62acf25a-029f-4f4c-9a49-c60a2694410b),SecurityGroupRule(fc1beb6f-e5d0-411c-b65a-8d2e182b59b6)],shared=False,stateful=True,updated_at=2022-09-04T01:12:59Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:00.121223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-d0c4f950-c627-41bc-82d5-5574e1c9e75c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (cb7bdb01-481f-49db-b508-78671b73e42e), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:00.121223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-d0c4f950-c627-41bc-82d5-5574e1c9e75c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:12:59Z,description=,direction='ingress',ethertype='IPv4',id=0e378931-7fb4-4a1f-b732-3941ef7a5f0b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fdb2b7eabf214f66a355bd53eebdb9f5',protocol=,remote_address_group_id=,remote_group_id=cb7bdb01-481f-49db-b508-78671b73e42e,remote_ip_prefix=,revision_number=0,security_group_id=cb7bdb01-481f-49db-b508-78671b73e42e,updated_at=2022-09-04T01:12:59Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:00.121223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-d0c4f950-c627-41bc-82d5-5574e1c9e75c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (0e378931-7fb4-4a1f-b732-3941ef7a5f0b), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:00.121223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-d0c4f950-c627-41bc-82d5-5574e1c9e75c admin admin] Security group rule updated ['cb7bdb01-481f-49db-b508-78671b73e42e'] Sep 04 01:13:00.121564 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-d0c4f950-c627-41bc-82d5-5574e1c9e75c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:12:59Z,description=,direction='egress',ethertype='IPv4',id=5a155d9b-64cc-45a8-b4bc-7f304cd02c78,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fdb2b7eabf214f66a355bd53eebdb9f5',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=cb7bdb01-481f-49db-b508-78671b73e42e,updated_at=2022-09-04T01:12:59Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:00.121564 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-d0c4f950-c627-41bc-82d5-5574e1c9e75c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (5a155d9b-64cc-45a8-b4bc-7f304cd02c78), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:00.121564 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-d0c4f950-c627-41bc-82d5-5574e1c9e75c admin admin] Security group rule updated ['cb7bdb01-481f-49db-b508-78671b73e42e'] Sep 04 01:13:00.121837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-d0c4f950-c627-41bc-82d5-5574e1c9e75c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:12:59Z,description=,direction='egress',ethertype='IPv6',id=62acf25a-029f-4f4c-9a49-c60a2694410b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fdb2b7eabf214f66a355bd53eebdb9f5',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=cb7bdb01-481f-49db-b508-78671b73e42e,updated_at=2022-09-04T01:12:59Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:00.121837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-d0c4f950-c627-41bc-82d5-5574e1c9e75c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (62acf25a-029f-4f4c-9a49-c60a2694410b), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:00.121837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-d0c4f950-c627-41bc-82d5-5574e1c9e75c admin admin] Security group rule updated ['cb7bdb01-481f-49db-b508-78671b73e42e'] Sep 04 01:13:00.122127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-d0c4f950-c627-41bc-82d5-5574e1c9e75c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:12:59Z,description=,direction='ingress',ethertype='IPv6',id=fc1beb6f-e5d0-411c-b65a-8d2e182b59b6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fdb2b7eabf214f66a355bd53eebdb9f5',protocol=,remote_address_group_id=,remote_group_id=cb7bdb01-481f-49db-b508-78671b73e42e,remote_ip_prefix=,revision_number=0,security_group_id=cb7bdb01-481f-49db-b508-78671b73e42e,updated_at=2022-09-04T01:12:59Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:00.122127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-d0c4f950-c627-41bc-82d5-5574e1c9e75c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (fc1beb6f-e5d0-411c-b65a-8d2e182b59b6), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:00.122127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-d0c4f950-c627-41bc-82d5-5574e1c9e75c admin admin] Security group rule updated ['cb7bdb01-481f-49db-b508-78671b73e42e'] Sep 04 01:13:00.361525 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-10b1f0e1-48f7-4f2a-baca-f6369ed0769c admin admin] Resource SecurityGroup deleted: cb7bdb01-481f-49db-b508-78671b73e42e {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:00.362435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-10b1f0e1-48f7-4f2a-baca-f6369ed0769c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (cb7bdb01-481f-49db-b508-78671b73e42e), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:00.363190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10b1f0e1-48f7-4f2a-baca-f6369ed0769c admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('cb7bdb01-481f-49db-b508-78671b73e42e',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:13:00.379019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-10b1f0e1-48f7-4f2a-baca-f6369ed0769c admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('cb7bdb01-481f-49db-b508-78671b73e42e',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:13:00.379640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-10b1f0e1-48f7-4f2a-baca-f6369ed0769c admin admin] Resource SecurityGroupRule deleted: 0e378931-7fb4-4a1f-b732-3941ef7a5f0b {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:00.380013 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-10b1f0e1-48f7-4f2a-baca-f6369ed0769c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (0e378931-7fb4-4a1f-b732-3941ef7a5f0b), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:00.380348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-10b1f0e1-48f7-4f2a-baca-f6369ed0769c admin admin] Security group rule updated ['cb7bdb01-481f-49db-b508-78671b73e42e'] Sep 04 01:13:00.380783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-10b1f0e1-48f7-4f2a-baca-f6369ed0769c admin admin] Resource SecurityGroupRule deleted: 5a155d9b-64cc-45a8-b4bc-7f304cd02c78 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:00.381150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-10b1f0e1-48f7-4f2a-baca-f6369ed0769c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (5a155d9b-64cc-45a8-b4bc-7f304cd02c78), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:00.381473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-10b1f0e1-48f7-4f2a-baca-f6369ed0769c admin admin] Security group rule updated ['cb7bdb01-481f-49db-b508-78671b73e42e'] Sep 04 01:13:00.381893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-10b1f0e1-48f7-4f2a-baca-f6369ed0769c admin admin] Resource SecurityGroupRule deleted: 62acf25a-029f-4f4c-9a49-c60a2694410b {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:00.382234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-10b1f0e1-48f7-4f2a-baca-f6369ed0769c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (62acf25a-029f-4f4c-9a49-c60a2694410b), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:00.382551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-10b1f0e1-48f7-4f2a-baca-f6369ed0769c admin admin] Security group rule updated ['cb7bdb01-481f-49db-b508-78671b73e42e'] Sep 04 01:13:00.382963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-10b1f0e1-48f7-4f2a-baca-f6369ed0769c admin admin] Resource SecurityGroupRule deleted: fc1beb6f-e5d0-411c-b65a-8d2e182b59b6 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:00.383301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-10b1f0e1-48f7-4f2a-baca-f6369ed0769c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (fc1beb6f-e5d0-411c-b65a-8d2e182b59b6), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:00.383617 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-10b1f0e1-48f7-4f2a-baca-f6369ed0769c admin admin] Security group rule updated ['cb7bdb01-481f-49db-b508-78671b73e42e'] Sep 04 01:13:00.494937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:485 started Sep 04 01:13:00.497515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade571f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=889000000,duration_sec=989,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:13:00.498026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:13:00.498396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:485 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:13:00.506446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-855c4eca-8923-4bd8-a72b-ee1746f209a1 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:13:00Z,description='Default security group',id=ac761a81-c56f-44a9-8fe1-29dcf33e993a,is_default=True,name='default',project_id='0af4373504224763a31adfd64271d0a2',revision_number=1,rules=[SecurityGroupRule(75a17e4c-be73-446b-b9c2-eddef0dac31e),SecurityGroupRule(79c767ec-b33d-4826-b817-3e5224e3d2b1),SecurityGroupRule(c27af213-de47-439c-bc1f-e4f00c119d08),SecurityGroupRule(fc206c64-80c5-412f-8c58-4acddf3c88a5)],shared=False,stateful=True,updated_at=2022-09-04T01:13:00Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:00.506810 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-855c4eca-8923-4bd8-a72b-ee1746f209a1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (ac761a81-c56f-44a9-8fe1-29dcf33e993a), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:00.507431 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-855c4eca-8923-4bd8-a72b-ee1746f209a1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:13:00Z,description=,direction='ingress',ethertype='IPv4',id=75a17e4c-be73-446b-b9c2-eddef0dac31e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0af4373504224763a31adfd64271d0a2',protocol=,remote_address_group_id=,remote_group_id=ac761a81-c56f-44a9-8fe1-29dcf33e993a,remote_ip_prefix=,revision_number=0,security_group_id=ac761a81-c56f-44a9-8fe1-29dcf33e993a,updated_at=2022-09-04T01:13:00Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:00.508162 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-855c4eca-8923-4bd8-a72b-ee1746f209a1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (75a17e4c-be73-446b-b9c2-eddef0dac31e), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:00.508555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-855c4eca-8923-4bd8-a72b-ee1746f209a1 admin admin] Security group rule updated ['ac761a81-c56f-44a9-8fe1-29dcf33e993a'] Sep 04 01:13:00.509521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-855c4eca-8923-4bd8-a72b-ee1746f209a1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:13:00Z,description=,direction='egress',ethertype='IPv6',id=79c767ec-b33d-4826-b817-3e5224e3d2b1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0af4373504224763a31adfd64271d0a2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ac761a81-c56f-44a9-8fe1-29dcf33e993a,updated_at=2022-09-04T01:13:00Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:00.509960 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-855c4eca-8923-4bd8-a72b-ee1746f209a1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (79c767ec-b33d-4826-b817-3e5224e3d2b1), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:00.510385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-855c4eca-8923-4bd8-a72b-ee1746f209a1 admin admin] Security group rule updated ['ac761a81-c56f-44a9-8fe1-29dcf33e993a'] Sep 04 01:13:00.511184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-855c4eca-8923-4bd8-a72b-ee1746f209a1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:13:00Z,description=,direction='egress',ethertype='IPv4',id=c27af213-de47-439c-bc1f-e4f00c119d08,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0af4373504224763a31adfd64271d0a2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ac761a81-c56f-44a9-8fe1-29dcf33e993a,updated_at=2022-09-04T01:13:00Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:00.511658 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-855c4eca-8923-4bd8-a72b-ee1746f209a1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (c27af213-de47-439c-bc1f-e4f00c119d08), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:00.512201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-855c4eca-8923-4bd8-a72b-ee1746f209a1 admin admin] Security group rule updated ['ac761a81-c56f-44a9-8fe1-29dcf33e993a'] Sep 04 01:13:00.512983 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-855c4eca-8923-4bd8-a72b-ee1746f209a1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:13:00Z,description=,direction='ingress',ethertype='IPv6',id=fc206c64-80c5-412f-8c58-4acddf3c88a5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0af4373504224763a31adfd64271d0a2',protocol=,remote_address_group_id=,remote_group_id=ac761a81-c56f-44a9-8fe1-29dcf33e993a,remote_ip_prefix=,revision_number=0,security_group_id=ac761a81-c56f-44a9-8fe1-29dcf33e993a,updated_at=2022-09-04T01:13:00Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:00.513422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-855c4eca-8923-4bd8-a72b-ee1746f209a1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (fc206c64-80c5-412f-8c58-4acddf3c88a5), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:00.513856 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-855c4eca-8923-4bd8-a72b-ee1746f209a1 admin admin] Security group rule updated ['ac761a81-c56f-44a9-8fe1-29dcf33e993a'] Sep 04 01:13:00.741858 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-01390312-5f28-4b0c-a2c4-40669408791b admin admin] Resource SecurityGroup deleted: ac761a81-c56f-44a9-8fe1-29dcf33e993a {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:00.749307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-01390312-5f28-4b0c-a2c4-40669408791b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (ac761a81-c56f-44a9-8fe1-29dcf33e993a), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:00.749307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01390312-5f28-4b0c-a2c4-40669408791b admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('ac761a81-c56f-44a9-8fe1-29dcf33e993a',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:13:00.763960 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-01390312-5f28-4b0c-a2c4-40669408791b admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('ac761a81-c56f-44a9-8fe1-29dcf33e993a',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:13:00.764385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-01390312-5f28-4b0c-a2c4-40669408791b admin admin] Resource SecurityGroupRule deleted: 75a17e4c-be73-446b-b9c2-eddef0dac31e {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:00.764763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-01390312-5f28-4b0c-a2c4-40669408791b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (75a17e4c-be73-446b-b9c2-eddef0dac31e), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:00.765128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-01390312-5f28-4b0c-a2c4-40669408791b admin admin] Security group rule updated ['ac761a81-c56f-44a9-8fe1-29dcf33e993a'] Sep 04 01:13:00.765564 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-01390312-5f28-4b0c-a2c4-40669408791b admin admin] Resource SecurityGroupRule deleted: 79c767ec-b33d-4826-b817-3e5224e3d2b1 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:00.765920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-01390312-5f28-4b0c-a2c4-40669408791b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (79c767ec-b33d-4826-b817-3e5224e3d2b1), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:00.766295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-01390312-5f28-4b0c-a2c4-40669408791b admin admin] Security group rule updated ['ac761a81-c56f-44a9-8fe1-29dcf33e993a'] Sep 04 01:13:00.766723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-01390312-5f28-4b0c-a2c4-40669408791b admin admin] Resource SecurityGroupRule deleted: c27af213-de47-439c-bc1f-e4f00c119d08 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:00.767071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-01390312-5f28-4b0c-a2c4-40669408791b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (c27af213-de47-439c-bc1f-e4f00c119d08), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:00.767398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-01390312-5f28-4b0c-a2c4-40669408791b admin admin] Security group rule updated ['ac761a81-c56f-44a9-8fe1-29dcf33e993a'] Sep 04 01:13:00.767819 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-01390312-5f28-4b0c-a2c4-40669408791b admin admin] Resource SecurityGroupRule deleted: fc206c64-80c5-412f-8c58-4acddf3c88a5 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:00.768163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-01390312-5f28-4b0c-a2c4-40669408791b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (fc206c64-80c5-412f-8c58-4acddf3c88a5), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:00.768479 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-01390312-5f28-4b0c-a2c4-40669408791b admin admin] Security group rule updated ['ac761a81-c56f-44a9-8fe1-29dcf33e993a'] Sep 04 01:13:00.988957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-d6cacd4e-afac-47b3-8d1e-ff8fec2fa85f admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:13:00Z,description='Default security group',id=324a1b62-aafb-42e2-a94f-2ddfffc73b60,is_default=True,name='default',project_id='83428cdb97544c7b8ea4bf9a69d7106f',revision_number=1,rules=[SecurityGroupRule(1821dbd4-2c12-4641-aa94-f79b8da3133b),SecurityGroupRule(47d34c99-bc80-47a0-b6c2-a52d8e8ea95a),SecurityGroupRule(5de91c4d-bb48-449d-b38a-b11da350e2a5),SecurityGroupRule(b0019da0-fb28-4204-bd40-167ad4ddde3e)],shared=False,stateful=True,updated_at=2022-09-04T01:13:00Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:00.988957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-d6cacd4e-afac-47b3-8d1e-ff8fec2fa85f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (324a1b62-aafb-42e2-a94f-2ddfffc73b60), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:00.988957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-d6cacd4e-afac-47b3-8d1e-ff8fec2fa85f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:13:00Z,description=,direction='ingress',ethertype='IPv6',id=1821dbd4-2c12-4641-aa94-f79b8da3133b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='83428cdb97544c7b8ea4bf9a69d7106f',protocol=,remote_address_group_id=,remote_group_id=324a1b62-aafb-42e2-a94f-2ddfffc73b60,remote_ip_prefix=,revision_number=0,security_group_id=324a1b62-aafb-42e2-a94f-2ddfffc73b60,updated_at=2022-09-04T01:13:00Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:00.990173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-d6cacd4e-afac-47b3-8d1e-ff8fec2fa85f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (1821dbd4-2c12-4641-aa94-f79b8da3133b), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:00.990173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-d6cacd4e-afac-47b3-8d1e-ff8fec2fa85f admin admin] Security group rule updated ['324a1b62-aafb-42e2-a94f-2ddfffc73b60'] Sep 04 01:13:00.990173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-d6cacd4e-afac-47b3-8d1e-ff8fec2fa85f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:13:00Z,description=,direction='egress',ethertype='IPv6',id=47d34c99-bc80-47a0-b6c2-a52d8e8ea95a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='83428cdb97544c7b8ea4bf9a69d7106f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=324a1b62-aafb-42e2-a94f-2ddfffc73b60,updated_at=2022-09-04T01:13:00Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:00.990173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-d6cacd4e-afac-47b3-8d1e-ff8fec2fa85f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (47d34c99-bc80-47a0-b6c2-a52d8e8ea95a), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:00.990528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-d6cacd4e-afac-47b3-8d1e-ff8fec2fa85f admin admin] Security group rule updated ['324a1b62-aafb-42e2-a94f-2ddfffc73b60'] Sep 04 01:13:00.990528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-d6cacd4e-afac-47b3-8d1e-ff8fec2fa85f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:13:00Z,description=,direction='egress',ethertype='IPv4',id=5de91c4d-bb48-449d-b38a-b11da350e2a5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='83428cdb97544c7b8ea4bf9a69d7106f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=324a1b62-aafb-42e2-a94f-2ddfffc73b60,updated_at=2022-09-04T01:13:00Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:00.990528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-d6cacd4e-afac-47b3-8d1e-ff8fec2fa85f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (5de91c4d-bb48-449d-b38a-b11da350e2a5), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:00.990781 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-d6cacd4e-afac-47b3-8d1e-ff8fec2fa85f admin admin] Security group rule updated ['324a1b62-aafb-42e2-a94f-2ddfffc73b60'] Sep 04 01:13:00.991582 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-d6cacd4e-afac-47b3-8d1e-ff8fec2fa85f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:13:00Z,description=,direction='ingress',ethertype='IPv4',id=b0019da0-fb28-4204-bd40-167ad4ddde3e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='83428cdb97544c7b8ea4bf9a69d7106f',protocol=,remote_address_group_id=,remote_group_id=324a1b62-aafb-42e2-a94f-2ddfffc73b60,remote_ip_prefix=,revision_number=0,security_group_id=324a1b62-aafb-42e2-a94f-2ddfffc73b60,updated_at=2022-09-04T01:13:00Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:00.991810 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-d6cacd4e-afac-47b3-8d1e-ff8fec2fa85f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (b0019da0-fb28-4204-bd40-167ad4ddde3e), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:00.992404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-d6cacd4e-afac-47b3-8d1e-ff8fec2fa85f admin admin] Security group rule updated ['324a1b62-aafb-42e2-a94f-2ddfffc73b60'] Sep 04 01:13:01.228037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-940d9297-2957-4266-9e82-7a4e3b9ad846 admin admin] Resource SecurityGroup deleted: 324a1b62-aafb-42e2-a94f-2ddfffc73b60 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:01.228659 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-940d9297-2957-4266-9e82-7a4e3b9ad846 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (324a1b62-aafb-42e2-a94f-2ddfffc73b60), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:01.228859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-940d9297-2957-4266-9e82-7a4e3b9ad846 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('324a1b62-aafb-42e2-a94f-2ddfffc73b60',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:13:01.242239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-940d9297-2957-4266-9e82-7a4e3b9ad846 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('324a1b62-aafb-42e2-a94f-2ddfffc73b60',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:13:01.242674 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-940d9297-2957-4266-9e82-7a4e3b9ad846 admin admin] Resource SecurityGroupRule deleted: 1821dbd4-2c12-4641-aa94-f79b8da3133b {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:01.243037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-940d9297-2957-4266-9e82-7a4e3b9ad846 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (1821dbd4-2c12-4641-aa94-f79b8da3133b), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:01.243370 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-940d9297-2957-4266-9e82-7a4e3b9ad846 admin admin] Security group rule updated ['324a1b62-aafb-42e2-a94f-2ddfffc73b60'] Sep 04 01:13:01.243803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-940d9297-2957-4266-9e82-7a4e3b9ad846 admin admin] Resource SecurityGroupRule deleted: 47d34c99-bc80-47a0-b6c2-a52d8e8ea95a {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:01.244154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-940d9297-2957-4266-9e82-7a4e3b9ad846 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (47d34c99-bc80-47a0-b6c2-a52d8e8ea95a), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:01.244475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-940d9297-2957-4266-9e82-7a4e3b9ad846 admin admin] Security group rule updated ['324a1b62-aafb-42e2-a94f-2ddfffc73b60'] Sep 04 01:13:01.244888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-940d9297-2957-4266-9e82-7a4e3b9ad846 admin admin] Resource SecurityGroupRule deleted: 5de91c4d-bb48-449d-b38a-b11da350e2a5 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:01.245261 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-940d9297-2957-4266-9e82-7a4e3b9ad846 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (5de91c4d-bb48-449d-b38a-b11da350e2a5), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:01.245775 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-940d9297-2957-4266-9e82-7a4e3b9ad846 admin admin] Security group rule updated ['324a1b62-aafb-42e2-a94f-2ddfffc73b60'] Sep 04 01:13:01.246192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-940d9297-2957-4266-9e82-7a4e3b9ad846 admin admin] Resource SecurityGroupRule deleted: b0019da0-fb28-4204-bd40-167ad4ddde3e {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:01.246534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-940d9297-2957-4266-9e82-7a4e3b9ad846 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (b0019da0-fb28-4204-bd40-167ad4ddde3e), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:01.246964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-940d9297-2957-4266-9e82-7a4e3b9ad846 admin admin] Security group rule updated ['324a1b62-aafb-42e2-a94f-2ddfffc73b60'] Sep 04 01:13:01.597686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-d39724e9-2c11-4774-9865-aa51363ad25c admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:13:01Z,description='Default security group',id=32dbcb77-3177-4c43-b6c7-79119aaa94bc,is_default=True,name='default',project_id='15ed0cea1cd345429921b1083d321708',revision_number=1,rules=[SecurityGroupRule(4398ad02-9b6c-4a4c-aef5-db8498d29e80),SecurityGroupRule(54e43b5b-5685-47ac-804b-8571a3a623c7),SecurityGroupRule(cd29389b-8da9-4c98-a8f2-99ad97eede9d),SecurityGroupRule(ebe08ce2-d6c4-4ffa-a3e1-102b2b94146f)],shared=False,stateful=True,updated_at=2022-09-04T01:13:01Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:01.598483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-d39724e9-2c11-4774-9865-aa51363ad25c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (32dbcb77-3177-4c43-b6c7-79119aaa94bc), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:01.599279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-d39724e9-2c11-4774-9865-aa51363ad25c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:13:01Z,description=,direction='egress',ethertype='IPv6',id=4398ad02-9b6c-4a4c-aef5-db8498d29e80,normalized_cidr=None,port_range_max=,port_range_min=,project_id='15ed0cea1cd345429921b1083d321708',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=32dbcb77-3177-4c43-b6c7-79119aaa94bc,updated_at=2022-09-04T01:13:01Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:01.599814 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-d39724e9-2c11-4774-9865-aa51363ad25c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (4398ad02-9b6c-4a4c-aef5-db8498d29e80), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:01.600343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-d39724e9-2c11-4774-9865-aa51363ad25c admin admin] Security group rule updated ['32dbcb77-3177-4c43-b6c7-79119aaa94bc'] Sep 04 01:13:01.601260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-d39724e9-2c11-4774-9865-aa51363ad25c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:13:01Z,description=,direction='ingress',ethertype='IPv4',id=54e43b5b-5685-47ac-804b-8571a3a623c7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='15ed0cea1cd345429921b1083d321708',protocol=,remote_address_group_id=,remote_group_id=32dbcb77-3177-4c43-b6c7-79119aaa94bc,remote_ip_prefix=,revision_number=0,security_group_id=32dbcb77-3177-4c43-b6c7-79119aaa94bc,updated_at=2022-09-04T01:13:01Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:01.601798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-d39724e9-2c11-4774-9865-aa51363ad25c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (54e43b5b-5685-47ac-804b-8571a3a623c7), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:01.602558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-d39724e9-2c11-4774-9865-aa51363ad25c admin admin] Security group rule updated ['32dbcb77-3177-4c43-b6c7-79119aaa94bc'] Sep 04 01:13:01.603333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-d39724e9-2c11-4774-9865-aa51363ad25c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:13:01Z,description=,direction='egress',ethertype='IPv4',id=cd29389b-8da9-4c98-a8f2-99ad97eede9d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='15ed0cea1cd345429921b1083d321708',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=32dbcb77-3177-4c43-b6c7-79119aaa94bc,updated_at=2022-09-04T01:13:01Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:01.603707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-d39724e9-2c11-4774-9865-aa51363ad25c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (cd29389b-8da9-4c98-a8f2-99ad97eede9d), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:01.604062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-d39724e9-2c11-4774-9865-aa51363ad25c admin admin] Security group rule updated ['32dbcb77-3177-4c43-b6c7-79119aaa94bc'] Sep 04 01:13:01.604782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-d39724e9-2c11-4774-9865-aa51363ad25c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:13:01Z,description=,direction='ingress',ethertype='IPv6',id=ebe08ce2-d6c4-4ffa-a3e1-102b2b94146f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='15ed0cea1cd345429921b1083d321708',protocol=,remote_address_group_id=,remote_group_id=32dbcb77-3177-4c43-b6c7-79119aaa94bc,remote_ip_prefix=,revision_number=0,security_group_id=32dbcb77-3177-4c43-b6c7-79119aaa94bc,updated_at=2022-09-04T01:13:01Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:01.605160 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-d39724e9-2c11-4774-9865-aa51363ad25c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (ebe08ce2-d6c4-4ffa-a3e1-102b2b94146f), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:01.605496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-d39724e9-2c11-4774-9865-aa51363ad25c admin admin] Security group rule updated ['32dbcb77-3177-4c43-b6c7-79119aaa94bc'] Sep 04 01:13:01.797887 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-342b1471-4358-486b-8e99-4ba195e0ba4e admin admin] Resource SecurityGroup deleted: 32dbcb77-3177-4c43-b6c7-79119aaa94bc {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:01.798356 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-342b1471-4358-486b-8e99-4ba195e0ba4e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (32dbcb77-3177-4c43-b6c7-79119aaa94bc), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:01.798918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-342b1471-4358-486b-8e99-4ba195e0ba4e admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('32dbcb77-3177-4c43-b6c7-79119aaa94bc',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:13:01.811747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-342b1471-4358-486b-8e99-4ba195e0ba4e admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('32dbcb77-3177-4c43-b6c7-79119aaa94bc',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:13:01.812187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-342b1471-4358-486b-8e99-4ba195e0ba4e admin admin] Resource SecurityGroupRule deleted: 4398ad02-9b6c-4a4c-aef5-db8498d29e80 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:01.812579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-342b1471-4358-486b-8e99-4ba195e0ba4e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (4398ad02-9b6c-4a4c-aef5-db8498d29e80), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:01.812915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-342b1471-4358-486b-8e99-4ba195e0ba4e admin admin] Security group rule updated ['32dbcb77-3177-4c43-b6c7-79119aaa94bc'] Sep 04 01:13:01.813406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-342b1471-4358-486b-8e99-4ba195e0ba4e admin admin] Resource SecurityGroupRule deleted: 54e43b5b-5685-47ac-804b-8571a3a623c7 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:01.813770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-342b1471-4358-486b-8e99-4ba195e0ba4e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (54e43b5b-5685-47ac-804b-8571a3a623c7), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:01.814091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-342b1471-4358-486b-8e99-4ba195e0ba4e admin admin] Security group rule updated ['32dbcb77-3177-4c43-b6c7-79119aaa94bc'] Sep 04 01:13:01.814537 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-342b1471-4358-486b-8e99-4ba195e0ba4e admin admin] Resource SecurityGroupRule deleted: cd29389b-8da9-4c98-a8f2-99ad97eede9d {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:01.814926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-342b1471-4358-486b-8e99-4ba195e0ba4e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (cd29389b-8da9-4c98-a8f2-99ad97eede9d), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:01.815241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-342b1471-4358-486b-8e99-4ba195e0ba4e admin admin] Security group rule updated ['32dbcb77-3177-4c43-b6c7-79119aaa94bc'] Sep 04 01:13:01.815654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-342b1471-4358-486b-8e99-4ba195e0ba4e admin admin] Resource SecurityGroupRule deleted: ebe08ce2-d6c4-4ffa-a3e1-102b2b94146f {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:01.815992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-342b1471-4358-486b-8e99-4ba195e0ba4e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (ebe08ce2-d6c4-4ffa-a3e1-102b2b94146f), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:01.816330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-342b1471-4358-486b-8e99-4ba195e0ba4e admin admin] Security group rule updated ['32dbcb77-3177-4c43-b6c7-79119aaa94bc'] Sep 04 01:13:02.496697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:486 started Sep 04 01:13:02.499204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5721,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=891000000,duration_sec=991,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:13:02.500001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:13:02.500349 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:486 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:13:03.954796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-ebad7ee5-ae2c-4cab-8c6e-a8754107cd73 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:13:03Z,description='Default security group',id=299e7323-1def-4d53-8ba1-74c55cd07184,is_default=True,name='default',project_id='c42193bc84da4389a3c050979cd759e3',revision_number=1,rules=[SecurityGroupRule(112a99ad-f18a-4a33-9140-f556e15c749a),SecurityGroupRule(9eae6723-e956-41ba-b387-284fa17a696b),SecurityGroupRule(d6f4c2a8-d0d4-4728-ba95-7771694cde90),SecurityGroupRule(ef006bed-bcd3-40e6-90d5-4d952d6a9c86)],shared=False,stateful=True,updated_at=2022-09-04T01:13:03Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:03.956032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-ebad7ee5-ae2c-4cab-8c6e-a8754107cd73 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (299e7323-1def-4d53-8ba1-74c55cd07184), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:03.956652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-ebad7ee5-ae2c-4cab-8c6e-a8754107cd73 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:13:03Z,description=,direction='ingress',ethertype='IPv6',id=112a99ad-f18a-4a33-9140-f556e15c749a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c42193bc84da4389a3c050979cd759e3',protocol=,remote_address_group_id=,remote_group_id=299e7323-1def-4d53-8ba1-74c55cd07184,remote_ip_prefix=,revision_number=0,security_group_id=299e7323-1def-4d53-8ba1-74c55cd07184,updated_at=2022-09-04T01:13:03Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:03.957043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-ebad7ee5-ae2c-4cab-8c6e-a8754107cd73 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (112a99ad-f18a-4a33-9140-f556e15c749a), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:03.957419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-ebad7ee5-ae2c-4cab-8c6e-a8754107cd73 admin admin] Security group rule updated ['299e7323-1def-4d53-8ba1-74c55cd07184'] Sep 04 01:13:03.958264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-ebad7ee5-ae2c-4cab-8c6e-a8754107cd73 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:13:03Z,description=,direction='egress',ethertype='IPv6',id=9eae6723-e956-41ba-b387-284fa17a696b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c42193bc84da4389a3c050979cd759e3',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=299e7323-1def-4d53-8ba1-74c55cd07184,updated_at=2022-09-04T01:13:03Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:03.958624 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-ebad7ee5-ae2c-4cab-8c6e-a8754107cd73 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (9eae6723-e956-41ba-b387-284fa17a696b), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:03.958953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-ebad7ee5-ae2c-4cab-8c6e-a8754107cd73 admin admin] Security group rule updated ['299e7323-1def-4d53-8ba1-74c55cd07184'] Sep 04 01:13:03.959917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-ebad7ee5-ae2c-4cab-8c6e-a8754107cd73 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:13:03Z,description=,direction='ingress',ethertype='IPv4',id=d6f4c2a8-d0d4-4728-ba95-7771694cde90,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c42193bc84da4389a3c050979cd759e3',protocol=,remote_address_group_id=,remote_group_id=299e7323-1def-4d53-8ba1-74c55cd07184,remote_ip_prefix=,revision_number=0,security_group_id=299e7323-1def-4d53-8ba1-74c55cd07184,updated_at=2022-09-04T01:13:03Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:03.960279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-ebad7ee5-ae2c-4cab-8c6e-a8754107cd73 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (d6f4c2a8-d0d4-4728-ba95-7771694cde90), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:03.960705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-ebad7ee5-ae2c-4cab-8c6e-a8754107cd73 admin admin] Security group rule updated ['299e7323-1def-4d53-8ba1-74c55cd07184'] Sep 04 01:13:03.961963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-ebad7ee5-ae2c-4cab-8c6e-a8754107cd73 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:13:03Z,description=,direction='egress',ethertype='IPv4',id=ef006bed-bcd3-40e6-90d5-4d952d6a9c86,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c42193bc84da4389a3c050979cd759e3',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=299e7323-1def-4d53-8ba1-74c55cd07184,updated_at=2022-09-04T01:13:03Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:03.962317 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-ebad7ee5-ae2c-4cab-8c6e-a8754107cd73 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (ef006bed-bcd3-40e6-90d5-4d952d6a9c86), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:03.969607 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-ebad7ee5-ae2c-4cab-8c6e-a8754107cd73 admin admin] Security group rule updated ['299e7323-1def-4d53-8ba1-74c55cd07184'] Sep 04 01:13:04.195290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-48e71232-24ae-4494-acd8-bf8c1d29d03d admin admin] Resource SecurityGroup deleted: 299e7323-1def-4d53-8ba1-74c55cd07184 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:04.195728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-48e71232-24ae-4494-acd8-bf8c1d29d03d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (299e7323-1def-4d53-8ba1-74c55cd07184), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:04.196185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48e71232-24ae-4494-acd8-bf8c1d29d03d admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('299e7323-1def-4d53-8ba1-74c55cd07184',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:13:04.212011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-48e71232-24ae-4494-acd8-bf8c1d29d03d admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('299e7323-1def-4d53-8ba1-74c55cd07184',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:13:04.212011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-48e71232-24ae-4494-acd8-bf8c1d29d03d admin admin] Resource SecurityGroupRule deleted: 112a99ad-f18a-4a33-9140-f556e15c749a {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:04.212011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-48e71232-24ae-4494-acd8-bf8c1d29d03d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (112a99ad-f18a-4a33-9140-f556e15c749a), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:04.212011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-48e71232-24ae-4494-acd8-bf8c1d29d03d admin admin] Security group rule updated ['299e7323-1def-4d53-8ba1-74c55cd07184'] Sep 04 01:13:04.212378 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-48e71232-24ae-4494-acd8-bf8c1d29d03d admin admin] Resource SecurityGroupRule deleted: 9eae6723-e956-41ba-b387-284fa17a696b {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:04.213755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-48e71232-24ae-4494-acd8-bf8c1d29d03d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (9eae6723-e956-41ba-b387-284fa17a696b), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:04.213755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-48e71232-24ae-4494-acd8-bf8c1d29d03d admin admin] Security group rule updated ['299e7323-1def-4d53-8ba1-74c55cd07184'] Sep 04 01:13:04.214170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-48e71232-24ae-4494-acd8-bf8c1d29d03d admin admin] Resource SecurityGroupRule deleted: d6f4c2a8-d0d4-4728-ba95-7771694cde90 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:04.214523 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-48e71232-24ae-4494-acd8-bf8c1d29d03d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (d6f4c2a8-d0d4-4728-ba95-7771694cde90), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:04.215176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-48e71232-24ae-4494-acd8-bf8c1d29d03d admin admin] Security group rule updated ['299e7323-1def-4d53-8ba1-74c55cd07184'] Sep 04 01:13:04.215599 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-48e71232-24ae-4494-acd8-bf8c1d29d03d admin admin] Resource SecurityGroupRule deleted: ef006bed-bcd3-40e6-90d5-4d952d6a9c86 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:04.216822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-48e71232-24ae-4494-acd8-bf8c1d29d03d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (ef006bed-bcd3-40e6-90d5-4d952d6a9c86), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:04.217420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-48e71232-24ae-4494-acd8-bf8c1d29d03d admin admin] Security group rule updated ['299e7323-1def-4d53-8ba1-74c55cd07184'] Sep 04 01:13:04.497634 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:487 started Sep 04 01:13:04.500422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5723,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=892000000,duration_sec=993,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:13:04.500993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:13:04.501385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:487 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:13:05.198018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-206fef81-88bc-4793-8c0e-144e08ceaecf admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:13:04Z,description='Default security group',id=fe0ea5df-01f7-4252-aac8-9be33b7ad3bb,is_default=True,name='default',project_id='e66308011618464f9e6519da298e7d71',revision_number=1,rules=[SecurityGroupRule(0b5f1663-824c-477e-bdb5-d1eec3453738),SecurityGroupRule(1b8e33e4-31cb-4a03-9262-a2c31689af0d),SecurityGroupRule(62c67e06-5c2a-412a-b385-492576fe14b2),SecurityGroupRule(71cf9b9d-7acc-4984-89c4-ea9525333817)],shared=False,stateful=True,updated_at=2022-09-04T01:13:05Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:05.199329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-206fef81-88bc-4793-8c0e-144e08ceaecf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (fe0ea5df-01f7-4252-aac8-9be33b7ad3bb), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:05.200134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-206fef81-88bc-4793-8c0e-144e08ceaecf admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:13:05Z,description=,direction='ingress',ethertype='IPv4',id=0b5f1663-824c-477e-bdb5-d1eec3453738,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e66308011618464f9e6519da298e7d71',protocol=,remote_address_group_id=,remote_group_id=fe0ea5df-01f7-4252-aac8-9be33b7ad3bb,remote_ip_prefix=,revision_number=0,security_group_id=fe0ea5df-01f7-4252-aac8-9be33b7ad3bb,updated_at=2022-09-04T01:13:05Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:05.200643 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-206fef81-88bc-4793-8c0e-144e08ceaecf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (0b5f1663-824c-477e-bdb5-d1eec3453738), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:05.200982 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-206fef81-88bc-4793-8c0e-144e08ceaecf admin admin] Security group rule updated ['fe0ea5df-01f7-4252-aac8-9be33b7ad3bb'] Sep 04 01:13:05.202509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-206fef81-88bc-4793-8c0e-144e08ceaecf admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:13:05Z,description=,direction='ingress',ethertype='IPv6',id=1b8e33e4-31cb-4a03-9262-a2c31689af0d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e66308011618464f9e6519da298e7d71',protocol=,remote_address_group_id=,remote_group_id=fe0ea5df-01f7-4252-aac8-9be33b7ad3bb,remote_ip_prefix=,revision_number=0,security_group_id=fe0ea5df-01f7-4252-aac8-9be33b7ad3bb,updated_at=2022-09-04T01:13:05Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:05.202963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-206fef81-88bc-4793-8c0e-144e08ceaecf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (1b8e33e4-31cb-4a03-9262-a2c31689af0d), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:05.209833 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-206fef81-88bc-4793-8c0e-144e08ceaecf admin admin] Security group rule updated ['fe0ea5df-01f7-4252-aac8-9be33b7ad3bb'] Sep 04 01:13:05.210762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-206fef81-88bc-4793-8c0e-144e08ceaecf admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:13:05Z,description=,direction='egress',ethertype='IPv6',id=62c67e06-5c2a-412a-b385-492576fe14b2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e66308011618464f9e6519da298e7d71',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=fe0ea5df-01f7-4252-aac8-9be33b7ad3bb,updated_at=2022-09-04T01:13:05Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:05.211130 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-206fef81-88bc-4793-8c0e-144e08ceaecf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (62c67e06-5c2a-412a-b385-492576fe14b2), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:05.211714 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-206fef81-88bc-4793-8c0e-144e08ceaecf admin admin] Security group rule updated ['fe0ea5df-01f7-4252-aac8-9be33b7ad3bb'] Sep 04 01:13:05.212917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-206fef81-88bc-4793-8c0e-144e08ceaecf admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:13:05Z,description=,direction='egress',ethertype='IPv4',id=71cf9b9d-7acc-4984-89c4-ea9525333817,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e66308011618464f9e6519da298e7d71',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=fe0ea5df-01f7-4252-aac8-9be33b7ad3bb,updated_at=2022-09-04T01:13:05Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:05.213245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-206fef81-88bc-4793-8c0e-144e08ceaecf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (71cf9b9d-7acc-4984-89c4-ea9525333817), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:05.216502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-206fef81-88bc-4793-8c0e-144e08ceaecf admin admin] Security group rule updated ['fe0ea5df-01f7-4252-aac8-9be33b7ad3bb'] Sep 04 01:13:05.416781 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-5bd2eea6-087a-4a24-b531-9df2b70bf1cf admin admin] Resource SecurityGroup deleted: fe0ea5df-01f7-4252-aac8-9be33b7ad3bb {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:05.417300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-5bd2eea6-087a-4a24-b531-9df2b70bf1cf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (fe0ea5df-01f7-4252-aac8-9be33b7ad3bb), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:05.417621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bd2eea6-087a-4a24-b531-9df2b70bf1cf admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('fe0ea5df-01f7-4252-aac8-9be33b7ad3bb',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:13:05.433948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-5bd2eea6-087a-4a24-b531-9df2b70bf1cf admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('fe0ea5df-01f7-4252-aac8-9be33b7ad3bb',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:13:05.434265 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-5bd2eea6-087a-4a24-b531-9df2b70bf1cf admin admin] Resource SecurityGroupRule deleted: 0b5f1663-824c-477e-bdb5-d1eec3453738 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:05.434646 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-5bd2eea6-087a-4a24-b531-9df2b70bf1cf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (0b5f1663-824c-477e-bdb5-d1eec3453738), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:05.435066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-5bd2eea6-087a-4a24-b531-9df2b70bf1cf admin admin] Security group rule updated ['fe0ea5df-01f7-4252-aac8-9be33b7ad3bb'] Sep 04 01:13:05.435399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-5bd2eea6-087a-4a24-b531-9df2b70bf1cf admin admin] Resource SecurityGroupRule deleted: 1b8e33e4-31cb-4a03-9262-a2c31689af0d {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:05.435742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-5bd2eea6-087a-4a24-b531-9df2b70bf1cf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (1b8e33e4-31cb-4a03-9262-a2c31689af0d), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:05.436057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-5bd2eea6-087a-4a24-b531-9df2b70bf1cf admin admin] Security group rule updated ['fe0ea5df-01f7-4252-aac8-9be33b7ad3bb'] Sep 04 01:13:05.436467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-5bd2eea6-087a-4a24-b531-9df2b70bf1cf admin admin] Resource SecurityGroupRule deleted: 62c67e06-5c2a-412a-b385-492576fe14b2 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:05.436806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-5bd2eea6-087a-4a24-b531-9df2b70bf1cf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (62c67e06-5c2a-412a-b385-492576fe14b2), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:05.438019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-5bd2eea6-087a-4a24-b531-9df2b70bf1cf admin admin] Security group rule updated ['fe0ea5df-01f7-4252-aac8-9be33b7ad3bb'] Sep 04 01:13:05.438443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-5bd2eea6-087a-4a24-b531-9df2b70bf1cf admin admin] Resource SecurityGroupRule deleted: 71cf9b9d-7acc-4984-89c4-ea9525333817 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:05.438780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-5bd2eea6-087a-4a24-b531-9df2b70bf1cf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (71cf9b9d-7acc-4984-89c4-ea9525333817), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:05.439094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-5bd2eea6-087a-4a24-b531-9df2b70bf1cf admin admin] Security group rule updated ['fe0ea5df-01f7-4252-aac8-9be33b7ad3bb'] Sep 04 01:13:06.498359 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:488 started Sep 04 01:13:06.500799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5725,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=892000000,duration_sec=995,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:13:06.501402 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:13:06.501747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:488 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:13:08.499107 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:489 started Sep 04 01:13:08.502321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5727,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=894000000,duration_sec=997,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:13:08.502946 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:13:08.503476 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:489 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 04 01:13:08.908155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-47230e41-a658-4cc2-8c29-61b22e932951 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:13:08Z,description='Default security group',id=d888eb66-2976-49d3-8e27-ab791953052b,is_default=True,name='default',project_id='063c97af8ef74f7f86873dfa47c6798c',revision_number=1,rules=[SecurityGroupRule(3d79b611-ee6b-4caa-b599-eddff37ea67f),SecurityGroupRule(5190693b-090e-47f7-9321-dc3e8de6d6c4),SecurityGroupRule(bad5dfd1-9bcb-4731-8383-621e81e4995f),SecurityGroupRule(feaffd6c-2c2f-4267-835f-df63a4cfcf61)],shared=False,stateful=True,updated_at=2022-09-04T01:13:08Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:08.908609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-47230e41-a658-4cc2-8c29-61b22e932951 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (d888eb66-2976-49d3-8e27-ab791953052b), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:08.909261 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-47230e41-a658-4cc2-8c29-61b22e932951 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:13:08Z,description=,direction='ingress',ethertype='IPv4',id=3d79b611-ee6b-4caa-b599-eddff37ea67f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='063c97af8ef74f7f86873dfa47c6798c',protocol=,remote_address_group_id=,remote_group_id=d888eb66-2976-49d3-8e27-ab791953052b,remote_ip_prefix=,revision_number=0,security_group_id=d888eb66-2976-49d3-8e27-ab791953052b,updated_at=2022-09-04T01:13:08Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:08.909738 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-47230e41-a658-4cc2-8c29-61b22e932951 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (3d79b611-ee6b-4caa-b599-eddff37ea67f), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:08.910571 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-47230e41-a658-4cc2-8c29-61b22e932951 admin admin] Security group rule updated ['d888eb66-2976-49d3-8e27-ab791953052b'] Sep 04 01:13:08.911313 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-47230e41-a658-4cc2-8c29-61b22e932951 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:13:08Z,description=,direction='ingress',ethertype='IPv6',id=5190693b-090e-47f7-9321-dc3e8de6d6c4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='063c97af8ef74f7f86873dfa47c6798c',protocol=,remote_address_group_id=,remote_group_id=d888eb66-2976-49d3-8e27-ab791953052b,remote_ip_prefix=,revision_number=0,security_group_id=d888eb66-2976-49d3-8e27-ab791953052b,updated_at=2022-09-04T01:13:08Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:08.911864 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-47230e41-a658-4cc2-8c29-61b22e932951 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (5190693b-090e-47f7-9321-dc3e8de6d6c4), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:08.912191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-47230e41-a658-4cc2-8c29-61b22e932951 admin admin] Security group rule updated ['d888eb66-2976-49d3-8e27-ab791953052b'] Sep 04 01:13:08.912933 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-47230e41-a658-4cc2-8c29-61b22e932951 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:13:08Z,description=,direction='egress',ethertype='IPv6',id=bad5dfd1-9bcb-4731-8383-621e81e4995f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='063c97af8ef74f7f86873dfa47c6798c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=d888eb66-2976-49d3-8e27-ab791953052b,updated_at=2022-09-04T01:13:08Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:08.913293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-47230e41-a658-4cc2-8c29-61b22e932951 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (bad5dfd1-9bcb-4731-8383-621e81e4995f), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:08.913739 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-47230e41-a658-4cc2-8c29-61b22e932951 admin admin] Security group rule updated ['d888eb66-2976-49d3-8e27-ab791953052b'] Sep 04 01:13:08.914428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-47230e41-a658-4cc2-8c29-61b22e932951 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:13:08Z,description=,direction='egress',ethertype='IPv4',id=feaffd6c-2c2f-4267-835f-df63a4cfcf61,normalized_cidr=None,port_range_max=,port_range_min=,project_id='063c97af8ef74f7f86873dfa47c6798c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=d888eb66-2976-49d3-8e27-ab791953052b,updated_at=2022-09-04T01:13:08Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:08.914774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-47230e41-a658-4cc2-8c29-61b22e932951 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (feaffd6c-2c2f-4267-835f-df63a4cfcf61), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:08.915098 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-47230e41-a658-4cc2-8c29-61b22e932951 admin admin] Security group rule updated ['d888eb66-2976-49d3-8e27-ab791953052b'] Sep 04 01:13:09.088337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-9d1c3329-ad9e-492e-a669-63113d05ff7f admin admin] Resource SecurityGroup deleted: d888eb66-2976-49d3-8e27-ab791953052b {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:09.088766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-9d1c3329-ad9e-492e-a669-63113d05ff7f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (d888eb66-2976-49d3-8e27-ab791953052b), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:09.089219 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d1c3329-ad9e-492e-a669-63113d05ff7f admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('d888eb66-2976-49d3-8e27-ab791953052b',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:13:09.103222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-9d1c3329-ad9e-492e-a669-63113d05ff7f admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('d888eb66-2976-49d3-8e27-ab791953052b',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:13:09.103654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-9d1c3329-ad9e-492e-a669-63113d05ff7f admin admin] Resource SecurityGroupRule deleted: 3d79b611-ee6b-4caa-b599-eddff37ea67f {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:09.104026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-9d1c3329-ad9e-492e-a669-63113d05ff7f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (3d79b611-ee6b-4caa-b599-eddff37ea67f), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:09.104378 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-9d1c3329-ad9e-492e-a669-63113d05ff7f admin admin] Security group rule updated ['d888eb66-2976-49d3-8e27-ab791953052b'] Sep 04 01:13:09.104810 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-9d1c3329-ad9e-492e-a669-63113d05ff7f admin admin] Resource SecurityGroupRule deleted: 5190693b-090e-47f7-9321-dc3e8de6d6c4 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:09.105368 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-9d1c3329-ad9e-492e-a669-63113d05ff7f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (5190693b-090e-47f7-9321-dc3e8de6d6c4), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:09.105688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-9d1c3329-ad9e-492e-a669-63113d05ff7f admin admin] Security group rule updated ['d888eb66-2976-49d3-8e27-ab791953052b'] Sep 04 01:13:09.106512 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-9d1c3329-ad9e-492e-a669-63113d05ff7f admin admin] Resource SecurityGroupRule deleted: bad5dfd1-9bcb-4731-8383-621e81e4995f {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:09.106863 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-9d1c3329-ad9e-492e-a669-63113d05ff7f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (bad5dfd1-9bcb-4731-8383-621e81e4995f), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:09.107210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-9d1c3329-ad9e-492e-a669-63113d05ff7f admin admin] Security group rule updated ['d888eb66-2976-49d3-8e27-ab791953052b'] Sep 04 01:13:09.107626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-9d1c3329-ad9e-492e-a669-63113d05ff7f admin admin] Resource SecurityGroupRule deleted: feaffd6c-2c2f-4267-835f-df63a4cfcf61 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:09.107963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-9d1c3329-ad9e-492e-a669-63113d05ff7f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (feaffd6c-2c2f-4267-835f-df63a4cfcf61), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:09.108303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-9d1c3329-ad9e-492e-a669-63113d05ff7f admin admin] Security group rule updated ['d888eb66-2976-49d3-8e27-ab791953052b'] Sep 04 01:13:09.794680 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-f2a25bc9-6402-4147-9c25-9845fcff1aa8 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:13:09Z,description='Default security group',id=95123b7e-1b4e-42eb-9cd5-f3dcf2b778c1,is_default=True,name='default',project_id='0b88568150434a3fa2a239479a5a8efa',revision_number=1,rules=[SecurityGroupRule(1195aae1-34af-44f4-b9c4-702f812d0b81),SecurityGroupRule(3f76ffec-b2c6-44d2-8ae3-5f67fade4a10),SecurityGroupRule(be1128fe-eaaa-4dc1-9130-13d1d0298113),SecurityGroupRule(e6b98a1e-574e-403e-b0d4-518cb53fb317)],shared=False,stateful=True,updated_at=2022-09-04T01:13:09Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:09.795270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-f2a25bc9-6402-4147-9c25-9845fcff1aa8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (95123b7e-1b4e-42eb-9cd5-f3dcf2b778c1), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:09.795657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-f2a25bc9-6402-4147-9c25-9845fcff1aa8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:13:09Z,description=,direction='egress',ethertype='IPv4',id=1195aae1-34af-44f4-b9c4-702f812d0b81,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0b88568150434a3fa2a239479a5a8efa',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=95123b7e-1b4e-42eb-9cd5-f3dcf2b778c1,updated_at=2022-09-04T01:13:09Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:09.803157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-f2a25bc9-6402-4147-9c25-9845fcff1aa8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (1195aae1-34af-44f4-b9c4-702f812d0b81), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:09.803157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-f2a25bc9-6402-4147-9c25-9845fcff1aa8 admin admin] Security group rule updated ['95123b7e-1b4e-42eb-9cd5-f3dcf2b778c1'] Sep 04 01:13:09.803157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-f2a25bc9-6402-4147-9c25-9845fcff1aa8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:13:09Z,description=,direction='ingress',ethertype='IPv6',id=3f76ffec-b2c6-44d2-8ae3-5f67fade4a10,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0b88568150434a3fa2a239479a5a8efa',protocol=,remote_address_group_id=,remote_group_id=95123b7e-1b4e-42eb-9cd5-f3dcf2b778c1,remote_ip_prefix=,revision_number=0,security_group_id=95123b7e-1b4e-42eb-9cd5-f3dcf2b778c1,updated_at=2022-09-04T01:13:09Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:09.803157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-f2a25bc9-6402-4147-9c25-9845fcff1aa8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (3f76ffec-b2c6-44d2-8ae3-5f67fade4a10), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:09.803615 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-f2a25bc9-6402-4147-9c25-9845fcff1aa8 admin admin] Security group rule updated ['95123b7e-1b4e-42eb-9cd5-f3dcf2b778c1'] Sep 04 01:13:09.803615 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-f2a25bc9-6402-4147-9c25-9845fcff1aa8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:13:09Z,description=,direction='ingress',ethertype='IPv4',id=be1128fe-eaaa-4dc1-9130-13d1d0298113,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0b88568150434a3fa2a239479a5a8efa',protocol=,remote_address_group_id=,remote_group_id=95123b7e-1b4e-42eb-9cd5-f3dcf2b778c1,remote_ip_prefix=,revision_number=0,security_group_id=95123b7e-1b4e-42eb-9cd5-f3dcf2b778c1,updated_at=2022-09-04T01:13:09Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:09.803615 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-f2a25bc9-6402-4147-9c25-9845fcff1aa8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (be1128fe-eaaa-4dc1-9130-13d1d0298113), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:09.803615 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-f2a25bc9-6402-4147-9c25-9845fcff1aa8 admin admin] Security group rule updated ['95123b7e-1b4e-42eb-9cd5-f3dcf2b778c1'] Sep 04 01:13:09.803956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-f2a25bc9-6402-4147-9c25-9845fcff1aa8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:13:09Z,description=,direction='egress',ethertype='IPv6',id=e6b98a1e-574e-403e-b0d4-518cb53fb317,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0b88568150434a3fa2a239479a5a8efa',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=95123b7e-1b4e-42eb-9cd5-f3dcf2b778c1,updated_at=2022-09-04T01:13:09Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:09.803956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-f2a25bc9-6402-4147-9c25-9845fcff1aa8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (e6b98a1e-574e-403e-b0d4-518cb53fb317), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:09.803956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-f2a25bc9-6402-4147-9c25-9845fcff1aa8 admin admin] Security group rule updated ['95123b7e-1b4e-42eb-9cd5-f3dcf2b778c1'] Sep 04 01:13:09.983235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-f0a19bbb-0052-4526-b1e7-87627e0fbc58 admin admin] Resource SecurityGroup deleted: 95123b7e-1b4e-42eb-9cd5-f3dcf2b778c1 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:09.983636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-f0a19bbb-0052-4526-b1e7-87627e0fbc58 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (95123b7e-1b4e-42eb-9cd5-f3dcf2b778c1), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:09.984091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0a19bbb-0052-4526-b1e7-87627e0fbc58 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('95123b7e-1b4e-42eb-9cd5-f3dcf2b778c1',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:13:09.998589 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-f0a19bbb-0052-4526-b1e7-87627e0fbc58 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('95123b7e-1b4e-42eb-9cd5-f3dcf2b778c1',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:13:09.999071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-f0a19bbb-0052-4526-b1e7-87627e0fbc58 admin admin] Resource SecurityGroupRule deleted: 1195aae1-34af-44f4-b9c4-702f812d0b81 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:09.999479 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-f0a19bbb-0052-4526-b1e7-87627e0fbc58 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (1195aae1-34af-44f4-b9c4-702f812d0b81), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:09.999817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-f0a19bbb-0052-4526-b1e7-87627e0fbc58 admin admin] Security group rule updated ['95123b7e-1b4e-42eb-9cd5-f3dcf2b778c1'] Sep 04 01:13:10.000254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-f0a19bbb-0052-4526-b1e7-87627e0fbc58 admin admin] Resource SecurityGroupRule deleted: 3f76ffec-b2c6-44d2-8ae3-5f67fade4a10 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:10.000602 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-f0a19bbb-0052-4526-b1e7-87627e0fbc58 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (3f76ffec-b2c6-44d2-8ae3-5f67fade4a10), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:10.000945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-f0a19bbb-0052-4526-b1e7-87627e0fbc58 admin admin] Security group rule updated ['95123b7e-1b4e-42eb-9cd5-f3dcf2b778c1'] Sep 04 01:13:10.001414 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-f0a19bbb-0052-4526-b1e7-87627e0fbc58 admin admin] Resource SecurityGroupRule deleted: be1128fe-eaaa-4dc1-9130-13d1d0298113 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:10.001767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-f0a19bbb-0052-4526-b1e7-87627e0fbc58 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (be1128fe-eaaa-4dc1-9130-13d1d0298113), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:10.002085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-f0a19bbb-0052-4526-b1e7-87627e0fbc58 admin admin] Security group rule updated ['95123b7e-1b4e-42eb-9cd5-f3dcf2b778c1'] Sep 04 01:13:10.002529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-f0a19bbb-0052-4526-b1e7-87627e0fbc58 admin admin] Resource SecurityGroupRule deleted: e6b98a1e-574e-403e-b0d4-518cb53fb317 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:10.003001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-f0a19bbb-0052-4526-b1e7-87627e0fbc58 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (e6b98a1e-574e-403e-b0d4-518cb53fb317), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:10.003457 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-f0a19bbb-0052-4526-b1e7-87627e0fbc58 admin admin] Security group rule updated ['95123b7e-1b4e-42eb-9cd5-f3dcf2b778c1'] Sep 04 01:13:10.499989 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:490 started Sep 04 01:13:10.502496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5729,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=894000000,duration_sec=999,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:13:10.503055 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:13:10.503425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:490 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:13:12.501155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:491 started Sep 04 01:13:12.504121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade572b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=895000000,duration_sec=1001,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:13:12.504685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:13:12.505265 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:491 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:13:14.064354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-cceb0e71-85e2-4568-a690-f8123f5f860b admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:13:13Z,description='Default security group',id=5301ec76-4fbc-47ce-850e-fb1881c022a1,is_default=True,name='default',project_id='6841cb8436ae43ff843cf938e91711ab',revision_number=1,rules=[SecurityGroupRule(509ce1b3-0ee6-46f4-a4d6-ed0acf2fbc14),SecurityGroupRule(a9af68e1-3f7a-41e6-a075-8bb086dceac0),SecurityGroupRule(baca552b-6f11-4844-9ea0-280871753ce1),SecurityGroupRule(f1bc2fdc-e6a7-4cee-af33-3bb4bd4abcca)],shared=False,stateful=True,updated_at=2022-09-04T01:13:13Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:14.064957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-cceb0e71-85e2-4568-a690-f8123f5f860b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (5301ec76-4fbc-47ce-850e-fb1881c022a1), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:14.065492 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-cceb0e71-85e2-4568-a690-f8123f5f860b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:13:13Z,description=,direction='egress',ethertype='IPv6',id=509ce1b3-0ee6-46f4-a4d6-ed0acf2fbc14,normalized_cidr=None,port_range_max=,port_range_min=,project_id='6841cb8436ae43ff843cf938e91711ab',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=5301ec76-4fbc-47ce-850e-fb1881c022a1,updated_at=2022-09-04T01:13:13Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:14.065711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-cceb0e71-85e2-4568-a690-f8123f5f860b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (509ce1b3-0ee6-46f4-a4d6-ed0acf2fbc14), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:14.066558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-cceb0e71-85e2-4568-a690-f8123f5f860b admin admin] Security group rule updated ['5301ec76-4fbc-47ce-850e-fb1881c022a1'] Sep 04 01:13:14.067294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-cceb0e71-85e2-4568-a690-f8123f5f860b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:13:13Z,description=,direction='ingress',ethertype='IPv4',id=a9af68e1-3f7a-41e6-a075-8bb086dceac0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='6841cb8436ae43ff843cf938e91711ab',protocol=,remote_address_group_id=,remote_group_id=5301ec76-4fbc-47ce-850e-fb1881c022a1,remote_ip_prefix=,revision_number=0,security_group_id=5301ec76-4fbc-47ce-850e-fb1881c022a1,updated_at=2022-09-04T01:13:13Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:14.067716 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-cceb0e71-85e2-4568-a690-f8123f5f860b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (a9af68e1-3f7a-41e6-a075-8bb086dceac0), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:14.068044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-cceb0e71-85e2-4568-a690-f8123f5f860b admin admin] Security group rule updated ['5301ec76-4fbc-47ce-850e-fb1881c022a1'] Sep 04 01:13:14.068747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-cceb0e71-85e2-4568-a690-f8123f5f860b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:13:13Z,description=,direction='ingress',ethertype='IPv6',id=baca552b-6f11-4844-9ea0-280871753ce1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='6841cb8436ae43ff843cf938e91711ab',protocol=,remote_address_group_id=,remote_group_id=5301ec76-4fbc-47ce-850e-fb1881c022a1,remote_ip_prefix=,revision_number=0,security_group_id=5301ec76-4fbc-47ce-850e-fb1881c022a1,updated_at=2022-09-04T01:13:13Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:14.069126 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-cceb0e71-85e2-4568-a690-f8123f5f860b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (baca552b-6f11-4844-9ea0-280871753ce1), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:14.069456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-cceb0e71-85e2-4568-a690-f8123f5f860b admin admin] Security group rule updated ['5301ec76-4fbc-47ce-850e-fb1881c022a1'] Sep 04 01:13:14.070186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-cceb0e71-85e2-4568-a690-f8123f5f860b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:13:13Z,description=,direction='egress',ethertype='IPv4',id=f1bc2fdc-e6a7-4cee-af33-3bb4bd4abcca,normalized_cidr=None,port_range_max=,port_range_min=,project_id='6841cb8436ae43ff843cf938e91711ab',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=5301ec76-4fbc-47ce-850e-fb1881c022a1,updated_at=2022-09-04T01:13:13Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:14.070537 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-cceb0e71-85e2-4568-a690-f8123f5f860b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (f1bc2fdc-e6a7-4cee-af33-3bb4bd4abcca), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:14.070862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-cceb0e71-85e2-4568-a690-f8123f5f860b admin admin] Security group rule updated ['5301ec76-4fbc-47ce-850e-fb1881c022a1'] Sep 04 01:13:14.266273 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c49ca60b-245c-402f-8f22-bad2d6147c7d admin admin] Resource SecurityGroup deleted: 5301ec76-4fbc-47ce-850e-fb1881c022a1 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:14.266652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-c49ca60b-245c-402f-8f22-bad2d6147c7d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (5301ec76-4fbc-47ce-850e-fb1881c022a1), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:14.267299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c49ca60b-245c-402f-8f22-bad2d6147c7d admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('5301ec76-4fbc-47ce-850e-fb1881c022a1',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:13:14.280146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c49ca60b-245c-402f-8f22-bad2d6147c7d admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('5301ec76-4fbc-47ce-850e-fb1881c022a1',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:13:14.280646 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c49ca60b-245c-402f-8f22-bad2d6147c7d admin admin] Resource SecurityGroupRule deleted: 509ce1b3-0ee6-46f4-a4d6-ed0acf2fbc14 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:14.283544 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-c49ca60b-245c-402f-8f22-bad2d6147c7d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (509ce1b3-0ee6-46f4-a4d6-ed0acf2fbc14), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:14.283544 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-c49ca60b-245c-402f-8f22-bad2d6147c7d admin admin] Security group rule updated ['5301ec76-4fbc-47ce-850e-fb1881c022a1'] Sep 04 01:13:14.283544 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c49ca60b-245c-402f-8f22-bad2d6147c7d admin admin] Resource SecurityGroupRule deleted: a9af68e1-3f7a-41e6-a075-8bb086dceac0 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:14.283544 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-c49ca60b-245c-402f-8f22-bad2d6147c7d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (a9af68e1-3f7a-41e6-a075-8bb086dceac0), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:14.283544 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-c49ca60b-245c-402f-8f22-bad2d6147c7d admin admin] Security group rule updated ['5301ec76-4fbc-47ce-850e-fb1881c022a1'] Sep 04 01:13:14.284354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c49ca60b-245c-402f-8f22-bad2d6147c7d admin admin] Resource SecurityGroupRule deleted: baca552b-6f11-4844-9ea0-280871753ce1 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:14.284354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-c49ca60b-245c-402f-8f22-bad2d6147c7d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (baca552b-6f11-4844-9ea0-280871753ce1), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:14.284354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-c49ca60b-245c-402f-8f22-bad2d6147c7d admin admin] Security group rule updated ['5301ec76-4fbc-47ce-850e-fb1881c022a1'] Sep 04 01:13:14.284354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c49ca60b-245c-402f-8f22-bad2d6147c7d admin admin] Resource SecurityGroupRule deleted: f1bc2fdc-e6a7-4cee-af33-3bb4bd4abcca {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:14.284354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-c49ca60b-245c-402f-8f22-bad2d6147c7d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (f1bc2fdc-e6a7-4cee-af33-3bb4bd4abcca), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:14.284896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-c49ca60b-245c-402f-8f22-bad2d6147c7d admin admin] Security group rule updated ['5301ec76-4fbc-47ce-850e-fb1881c022a1'] Sep 04 01:13:14.502672 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:492 started Sep 04 01:13:14.505627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade572d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=897000000,duration_sec=1003,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:13:14.506201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:13:14.506555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:492 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:13:15.006615 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0d2163b7-a42f-4f24-972b-1572d15bbc4d admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:13:14Z,description='Default security group',id=4cd4c24d-7bac-4673-9f09-ebb78175bdcb,is_default=True,name='default',project_id='7ca56a8fae1747c6b2a17b632cb8d430',revision_number=1,rules=[SecurityGroupRule(5efcd1f7-bfd4-4a8b-a4fa-e10b11aadb83),SecurityGroupRule(72fc82ea-0838-4edb-9eb5-9e205739a537),SecurityGroupRule(a6c62ed3-20a7-47e7-806e-53b2df2e66f3),SecurityGroupRule(b1894ff1-d851-4f98-af2f-39e92f7b744a)],shared=False,stateful=True,updated_at=2022-09-04T01:13:14Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:15.006989 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-0d2163b7-a42f-4f24-972b-1572d15bbc4d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (4cd4c24d-7bac-4673-9f09-ebb78175bdcb), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:15.007630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0d2163b7-a42f-4f24-972b-1572d15bbc4d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:13:14Z,description=,direction='egress',ethertype='IPv6',id=5efcd1f7-bfd4-4a8b-a4fa-e10b11aadb83,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7ca56a8fae1747c6b2a17b632cb8d430',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=4cd4c24d-7bac-4673-9f09-ebb78175bdcb,updated_at=2022-09-04T01:13:14Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:15.007940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-0d2163b7-a42f-4f24-972b-1572d15bbc4d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (5efcd1f7-bfd4-4a8b-a4fa-e10b11aadb83), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:15.008267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-0d2163b7-a42f-4f24-972b-1572d15bbc4d admin admin] Security group rule updated ['4cd4c24d-7bac-4673-9f09-ebb78175bdcb'] Sep 04 01:13:15.008995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0d2163b7-a42f-4f24-972b-1572d15bbc4d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:13:14Z,description=,direction='ingress',ethertype='IPv6',id=72fc82ea-0838-4edb-9eb5-9e205739a537,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7ca56a8fae1747c6b2a17b632cb8d430',protocol=,remote_address_group_id=,remote_group_id=4cd4c24d-7bac-4673-9f09-ebb78175bdcb,remote_ip_prefix=,revision_number=0,security_group_id=4cd4c24d-7bac-4673-9f09-ebb78175bdcb,updated_at=2022-09-04T01:13:14Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:15.009370 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-0d2163b7-a42f-4f24-972b-1572d15bbc4d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (72fc82ea-0838-4edb-9eb5-9e205739a537), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:15.009693 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-0d2163b7-a42f-4f24-972b-1572d15bbc4d admin admin] Security group rule updated ['4cd4c24d-7bac-4673-9f09-ebb78175bdcb'] Sep 04 01:13:15.010380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0d2163b7-a42f-4f24-972b-1572d15bbc4d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:13:14Z,description=,direction='ingress',ethertype='IPv4',id=a6c62ed3-20a7-47e7-806e-53b2df2e66f3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7ca56a8fae1747c6b2a17b632cb8d430',protocol=,remote_address_group_id=,remote_group_id=4cd4c24d-7bac-4673-9f09-ebb78175bdcb,remote_ip_prefix=,revision_number=0,security_group_id=4cd4c24d-7bac-4673-9f09-ebb78175bdcb,updated_at=2022-09-04T01:13:14Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:15.010723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-0d2163b7-a42f-4f24-972b-1572d15bbc4d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (a6c62ed3-20a7-47e7-806e-53b2df2e66f3), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:15.011043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-0d2163b7-a42f-4f24-972b-1572d15bbc4d admin admin] Security group rule updated ['4cd4c24d-7bac-4673-9f09-ebb78175bdcb'] Sep 04 01:13:15.011714 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0d2163b7-a42f-4f24-972b-1572d15bbc4d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:13:14Z,description=,direction='egress',ethertype='IPv4',id=b1894ff1-d851-4f98-af2f-39e92f7b744a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7ca56a8fae1747c6b2a17b632cb8d430',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=4cd4c24d-7bac-4673-9f09-ebb78175bdcb,updated_at=2022-09-04T01:13:14Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:15.012053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-0d2163b7-a42f-4f24-972b-1572d15bbc4d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (b1894ff1-d851-4f98-af2f-39e92f7b744a), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:15.012393 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-0d2163b7-a42f-4f24-972b-1572d15bbc4d admin admin] Security group rule updated ['4cd4c24d-7bac-4673-9f09-ebb78175bdcb'] Sep 04 01:13:15.275311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-1bab59cc-6672-43c9-b65a-94273809919c admin admin] Resource SecurityGroup deleted: 4cd4c24d-7bac-4673-9f09-ebb78175bdcb {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:15.275876 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-1bab59cc-6672-43c9-b65a-94273809919c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (4cd4c24d-7bac-4673-9f09-ebb78175bdcb), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:15.276145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bab59cc-6672-43c9-b65a-94273809919c admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('4cd4c24d-7bac-4673-9f09-ebb78175bdcb',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:13:15.289361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-1bab59cc-6672-43c9-b65a-94273809919c admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('4cd4c24d-7bac-4673-9f09-ebb78175bdcb',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:13:15.294783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-1bab59cc-6672-43c9-b65a-94273809919c admin admin] Resource SecurityGroupRule deleted: 5efcd1f7-bfd4-4a8b-a4fa-e10b11aadb83 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:15.294783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-1bab59cc-6672-43c9-b65a-94273809919c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (5efcd1f7-bfd4-4a8b-a4fa-e10b11aadb83), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:15.294783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-1bab59cc-6672-43c9-b65a-94273809919c admin admin] Security group rule updated ['4cd4c24d-7bac-4673-9f09-ebb78175bdcb'] Sep 04 01:13:15.294783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-1bab59cc-6672-43c9-b65a-94273809919c admin admin] Resource SecurityGroupRule deleted: 72fc82ea-0838-4edb-9eb5-9e205739a537 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:15.294783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-1bab59cc-6672-43c9-b65a-94273809919c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (72fc82ea-0838-4edb-9eb5-9e205739a537), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:15.295196 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-1bab59cc-6672-43c9-b65a-94273809919c admin admin] Security group rule updated ['4cd4c24d-7bac-4673-9f09-ebb78175bdcb'] Sep 04 01:13:15.295196 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-1bab59cc-6672-43c9-b65a-94273809919c admin admin] Resource SecurityGroupRule deleted: a6c62ed3-20a7-47e7-806e-53b2df2e66f3 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:15.295196 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-1bab59cc-6672-43c9-b65a-94273809919c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (a6c62ed3-20a7-47e7-806e-53b2df2e66f3), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:15.295196 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-1bab59cc-6672-43c9-b65a-94273809919c admin admin] Security group rule updated ['4cd4c24d-7bac-4673-9f09-ebb78175bdcb'] Sep 04 01:13:15.295196 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-1bab59cc-6672-43c9-b65a-94273809919c admin admin] Resource SecurityGroupRule deleted: b1894ff1-d851-4f98-af2f-39e92f7b744a {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:15.295582 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-1bab59cc-6672-43c9-b65a-94273809919c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (b1894ff1-d851-4f98-af2f-39e92f7b744a), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:15.295582 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-1bab59cc-6672-43c9-b65a-94273809919c admin admin] Security group rule updated ['4cd4c24d-7bac-4673-9f09-ebb78175bdcb'] Sep 04 01:13:16.103444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-bc0d3aea-2e18-44f0-91c0-d846c4d544ee admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:13:15Z,description='Default security group',id=9da79e28-1ee6-4dd1-9b0d-b000777801ff,is_default=True,name='default',project_id='136206f1ccd544a5b27352822a9de9fc',revision_number=1,rules=[SecurityGroupRule(1752291b-e3a7-4197-bdb6-e86c445fac9b),SecurityGroupRule(199ad579-2873-4477-a935-f5f1dbd23e4a),SecurityGroupRule(691bb136-c2c4-4624-a1cb-f2340358f2f6),SecurityGroupRule(ddc0200a-e150-481e-b805-6a21e918214f)],shared=False,stateful=True,updated_at=2022-09-04T01:13:15Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:16.103827 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-bc0d3aea-2e18-44f0-91c0-d846c4d544ee admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (9da79e28-1ee6-4dd1-9b0d-b000777801ff), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:16.104463 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-bc0d3aea-2e18-44f0-91c0-d846c4d544ee admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:13:15Z,description=,direction='ingress',ethertype='IPv4',id=1752291b-e3a7-4197-bdb6-e86c445fac9b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='136206f1ccd544a5b27352822a9de9fc',protocol=,remote_address_group_id=,remote_group_id=9da79e28-1ee6-4dd1-9b0d-b000777801ff,remote_ip_prefix=,revision_number=0,security_group_id=9da79e28-1ee6-4dd1-9b0d-b000777801ff,updated_at=2022-09-04T01:13:15Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:16.104821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-bc0d3aea-2e18-44f0-91c0-d846c4d544ee admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (1752291b-e3a7-4197-bdb6-e86c445fac9b), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:16.105184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-bc0d3aea-2e18-44f0-91c0-d846c4d544ee admin admin] Security group rule updated ['9da79e28-1ee6-4dd1-9b0d-b000777801ff'] Sep 04 01:13:16.105961 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-bc0d3aea-2e18-44f0-91c0-d846c4d544ee admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:13:15Z,description=,direction='egress',ethertype='IPv6',id=199ad579-2873-4477-a935-f5f1dbd23e4a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='136206f1ccd544a5b27352822a9de9fc',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=9da79e28-1ee6-4dd1-9b0d-b000777801ff,updated_at=2022-09-04T01:13:15Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:16.106350 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-bc0d3aea-2e18-44f0-91c0-d846c4d544ee admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (199ad579-2873-4477-a935-f5f1dbd23e4a), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:16.106683 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-bc0d3aea-2e18-44f0-91c0-d846c4d544ee admin admin] Security group rule updated ['9da79e28-1ee6-4dd1-9b0d-b000777801ff'] Sep 04 01:13:16.107390 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-bc0d3aea-2e18-44f0-91c0-d846c4d544ee admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:13:15Z,description=,direction='ingress',ethertype='IPv6',id=691bb136-c2c4-4624-a1cb-f2340358f2f6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='136206f1ccd544a5b27352822a9de9fc',protocol=,remote_address_group_id=,remote_group_id=9da79e28-1ee6-4dd1-9b0d-b000777801ff,remote_ip_prefix=,revision_number=0,security_group_id=9da79e28-1ee6-4dd1-9b0d-b000777801ff,updated_at=2022-09-04T01:13:15Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:16.107746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-bc0d3aea-2e18-44f0-91c0-d846c4d544ee admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (691bb136-c2c4-4624-a1cb-f2340358f2f6), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:16.108186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-bc0d3aea-2e18-44f0-91c0-d846c4d544ee admin admin] Security group rule updated ['9da79e28-1ee6-4dd1-9b0d-b000777801ff'] Sep 04 01:13:16.108914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-bc0d3aea-2e18-44f0-91c0-d846c4d544ee admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:13:15Z,description=,direction='egress',ethertype='IPv4',id=ddc0200a-e150-481e-b805-6a21e918214f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='136206f1ccd544a5b27352822a9de9fc',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=9da79e28-1ee6-4dd1-9b0d-b000777801ff,updated_at=2022-09-04T01:13:15Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:16.109294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-bc0d3aea-2e18-44f0-91c0-d846c4d544ee admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (ddc0200a-e150-481e-b805-6a21e918214f), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:16.109626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-bc0d3aea-2e18-44f0-91c0-d846c4d544ee admin admin] Security group rule updated ['9da79e28-1ee6-4dd1-9b0d-b000777801ff'] Sep 04 01:13:16.280552 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-935cf06f-d752-42eb-b3e4-397b90e00cdf admin admin] Resource SecurityGroup deleted: 9da79e28-1ee6-4dd1-9b0d-b000777801ff {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:16.281749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-935cf06f-d752-42eb-b3e4-397b90e00cdf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (9da79e28-1ee6-4dd1-9b0d-b000777801ff), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:16.282452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-935cf06f-d752-42eb-b3e4-397b90e00cdf admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('9da79e28-1ee6-4dd1-9b0d-b000777801ff',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:13:16.301719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-935cf06f-d752-42eb-b3e4-397b90e00cdf admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('9da79e28-1ee6-4dd1-9b0d-b000777801ff',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:13:16.302264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-935cf06f-d752-42eb-b3e4-397b90e00cdf admin admin] Resource SecurityGroupRule deleted: 1752291b-e3a7-4197-bdb6-e86c445fac9b {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:16.302640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-935cf06f-d752-42eb-b3e4-397b90e00cdf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (1752291b-e3a7-4197-bdb6-e86c445fac9b), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:16.303037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-935cf06f-d752-42eb-b3e4-397b90e00cdf admin admin] Security group rule updated ['9da79e28-1ee6-4dd1-9b0d-b000777801ff'] Sep 04 01:13:16.303483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-935cf06f-d752-42eb-b3e4-397b90e00cdf admin admin] Resource SecurityGroupRule deleted: 199ad579-2873-4477-a935-f5f1dbd23e4a {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:16.303830 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-935cf06f-d752-42eb-b3e4-397b90e00cdf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (199ad579-2873-4477-a935-f5f1dbd23e4a), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:16.304152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-935cf06f-d752-42eb-b3e4-397b90e00cdf admin admin] Security group rule updated ['9da79e28-1ee6-4dd1-9b0d-b000777801ff'] Sep 04 01:13:16.304566 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-935cf06f-d752-42eb-b3e4-397b90e00cdf admin admin] Resource SecurityGroupRule deleted: 691bb136-c2c4-4624-a1cb-f2340358f2f6 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:16.304907 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-935cf06f-d752-42eb-b3e4-397b90e00cdf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (691bb136-c2c4-4624-a1cb-f2340358f2f6), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:16.305256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-935cf06f-d752-42eb-b3e4-397b90e00cdf admin admin] Security group rule updated ['9da79e28-1ee6-4dd1-9b0d-b000777801ff'] Sep 04 01:13:16.305694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-935cf06f-d752-42eb-b3e4-397b90e00cdf admin admin] Resource SecurityGroupRule deleted: ddc0200a-e150-481e-b805-6a21e918214f {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:16.306032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-935cf06f-d752-42eb-b3e4-397b90e00cdf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (ddc0200a-e150-481e-b805-6a21e918214f), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:16.306347 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-935cf06f-d752-42eb-b3e4-397b90e00cdf admin admin] Security group rule updated ['9da79e28-1ee6-4dd1-9b0d-b000777801ff'] Sep 04 01:13:16.503666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:493 started Sep 04 01:13:16.506257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade572f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=898000000,duration_sec=1005,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:13:16.506846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:13:16.510072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:493 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:13:18.504865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:494 started Sep 04 01:13:18.507332 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5731,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=899000000,duration_sec=1007,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:13:18.507903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:13:18.508262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:494 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:13:20.505897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:495 started Sep 04 01:13:20.508405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5733,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=900000000,duration_sec=1009,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:13:20.508971 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:13:20.509364 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:495 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:13:22.507708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:496 started Sep 04 01:13:22.510152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5735,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=902000000,duration_sec=1011,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:13:22.510716 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:13:22.511073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:496 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:13:24.509739 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:497 started Sep 04 01:13:24.512763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5737,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=904000000,duration_sec=1013,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:13:24.513379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:13:24.513723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:497 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 04 01:13:26.509674 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:498 started Sep 04 01:13:26.512049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5739,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=904000000,duration_sec=1015,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:13:26.512614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:13:26.512963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:498 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:13:28.510771 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:499 started Sep 04 01:13:28.513269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade573b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=905000000,duration_sec=1017,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:13:28.513823 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:13:28.514169 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:499 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:13:30.511953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:500 started Sep 04 01:13:30.514574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade573d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=906000000,duration_sec=1019,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:13:30.515142 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:13:30.515524 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:500 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:13:32.513349 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:501 started Sep 04 01:13:32.515797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade573f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=907000000,duration_sec=1021,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:13:32.516390 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:13:32.516759 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:501 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:13:34.514616 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:502 started Sep 04 01:13:34.516927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5741,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=909000000,duration_sec=1023,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:13:34.517506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:13:34.517884 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:502 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:13:36.056086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-35079577-6d31-4c4c-a6af-ca8b886f006a admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:13:35Z,description='Default security group',id=aea75965-d3ae-424c-bbd8-489d01c14f41,is_default=True,name='default',project_id='a5edd00a8bd348cca2077c065556d42b',revision_number=1,rules=[SecurityGroupRule(0824dc3e-3423-4656-bcec-6c01721169f3),SecurityGroupRule(2cd62620-e124-43aa-830c-087adb310350),SecurityGroupRule(7efb89c0-fab6-4097-a8ac-f407dcfddd0d),SecurityGroupRule(ce02aaca-bb0d-48c6-bf7a-fcb940429062)],shared=False,stateful=True,updated_at=2022-09-04T01:13:35Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:36.056677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-35079577-6d31-4c4c-a6af-ca8b886f006a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (aea75965-d3ae-424c-bbd8-489d01c14f41), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:36.057107 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-35079577-6d31-4c4c-a6af-ca8b886f006a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:13:35Z,description=,direction='ingress',ethertype='IPv4',id=0824dc3e-3423-4656-bcec-6c01721169f3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a5edd00a8bd348cca2077c065556d42b',protocol=,remote_address_group_id=,remote_group_id=aea75965-d3ae-424c-bbd8-489d01c14f41,remote_ip_prefix=,revision_number=0,security_group_id=aea75965-d3ae-424c-bbd8-489d01c14f41,updated_at=2022-09-04T01:13:35Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:36.057455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-35079577-6d31-4c4c-a6af-ca8b886f006a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (0824dc3e-3423-4656-bcec-6c01721169f3), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:36.058304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-35079577-6d31-4c4c-a6af-ca8b886f006a admin admin] Security group rule updated ['aea75965-d3ae-424c-bbd8-489d01c14f41'] Sep 04 01:13:36.059120 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-35079577-6d31-4c4c-a6af-ca8b886f006a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:13:35Z,description=,direction='ingress',ethertype='IPv6',id=2cd62620-e124-43aa-830c-087adb310350,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a5edd00a8bd348cca2077c065556d42b',protocol=,remote_address_group_id=,remote_group_id=aea75965-d3ae-424c-bbd8-489d01c14f41,remote_ip_prefix=,revision_number=0,security_group_id=aea75965-d3ae-424c-bbd8-489d01c14f41,updated_at=2022-09-04T01:13:35Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:36.059477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-35079577-6d31-4c4c-a6af-ca8b886f006a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (2cd62620-e124-43aa-830c-087adb310350), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:36.059806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-35079577-6d31-4c4c-a6af-ca8b886f006a admin admin] Security group rule updated ['aea75965-d3ae-424c-bbd8-489d01c14f41'] Sep 04 01:13:36.060506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-35079577-6d31-4c4c-a6af-ca8b886f006a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:13:35Z,description=,direction='egress',ethertype='IPv6',id=7efb89c0-fab6-4097-a8ac-f407dcfddd0d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a5edd00a8bd348cca2077c065556d42b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=aea75965-d3ae-424c-bbd8-489d01c14f41,updated_at=2022-09-04T01:13:35Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:36.060859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-35079577-6d31-4c4c-a6af-ca8b886f006a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (7efb89c0-fab6-4097-a8ac-f407dcfddd0d), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:36.061219 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-35079577-6d31-4c4c-a6af-ca8b886f006a admin admin] Security group rule updated ['aea75965-d3ae-424c-bbd8-489d01c14f41'] Sep 04 01:13:36.062229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-35079577-6d31-4c4c-a6af-ca8b886f006a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:13:35Z,description=,direction='egress',ethertype='IPv4',id=ce02aaca-bb0d-48c6-bf7a-fcb940429062,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a5edd00a8bd348cca2077c065556d42b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=aea75965-d3ae-424c-bbd8-489d01c14f41,updated_at=2022-09-04T01:13:35Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:36.062229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-35079577-6d31-4c4c-a6af-ca8b886f006a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (ce02aaca-bb0d-48c6-bf7a-fcb940429062), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:36.062568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-35079577-6d31-4c4c-a6af-ca8b886f006a admin admin] Security group rule updated ['aea75965-d3ae-424c-bbd8-489d01c14f41'] Sep 04 01:13:36.271186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-36d5a333-bd90-47a9-9747-32bedfaa414d admin admin] Resource SecurityGroup deleted: aea75965-d3ae-424c-bbd8-489d01c14f41 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:36.271633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-36d5a333-bd90-47a9-9747-32bedfaa414d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (aea75965-d3ae-424c-bbd8-489d01c14f41), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:36.272173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36d5a333-bd90-47a9-9747-32bedfaa414d admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('aea75965-d3ae-424c-bbd8-489d01c14f41',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:13:36.291865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-36d5a333-bd90-47a9-9747-32bedfaa414d admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('aea75965-d3ae-424c-bbd8-489d01c14f41',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:13:36.292901 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-36d5a333-bd90-47a9-9747-32bedfaa414d admin admin] Resource SecurityGroupRule deleted: 0824dc3e-3423-4656-bcec-6c01721169f3 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:36.293357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-36d5a333-bd90-47a9-9747-32bedfaa414d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (0824dc3e-3423-4656-bcec-6c01721169f3), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:36.293783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-36d5a333-bd90-47a9-9747-32bedfaa414d admin admin] Security group rule updated ['aea75965-d3ae-424c-bbd8-489d01c14f41'] Sep 04 01:13:36.294289 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-36d5a333-bd90-47a9-9747-32bedfaa414d admin admin] Resource SecurityGroupRule deleted: 2cd62620-e124-43aa-830c-087adb310350 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:36.294693 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-36d5a333-bd90-47a9-9747-32bedfaa414d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (2cd62620-e124-43aa-830c-087adb310350), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:36.295267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-36d5a333-bd90-47a9-9747-32bedfaa414d admin admin] Security group rule updated ['aea75965-d3ae-424c-bbd8-489d01c14f41'] Sep 04 01:13:36.295751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-36d5a333-bd90-47a9-9747-32bedfaa414d admin admin] Resource SecurityGroupRule deleted: 7efb89c0-fab6-4097-a8ac-f407dcfddd0d {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:36.296322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-36d5a333-bd90-47a9-9747-32bedfaa414d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (7efb89c0-fab6-4097-a8ac-f407dcfddd0d), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:36.296710 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-36d5a333-bd90-47a9-9747-32bedfaa414d admin admin] Security group rule updated ['aea75965-d3ae-424c-bbd8-489d01c14f41'] Sep 04 01:13:36.297245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-36d5a333-bd90-47a9-9747-32bedfaa414d admin admin] Resource SecurityGroupRule deleted: ce02aaca-bb0d-48c6-bf7a-fcb940429062 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:36.297651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-36d5a333-bd90-47a9-9747-32bedfaa414d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (ce02aaca-bb0d-48c6-bf7a-fcb940429062), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:36.298050 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-36d5a333-bd90-47a9-9747-32bedfaa414d admin admin] Security group rule updated ['aea75965-d3ae-424c-bbd8-489d01c14f41'] Sep 04 01:13:36.515677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:503 started Sep 04 01:13:36.518812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5743,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=910000000,duration_sec=1025,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:13:36.519395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:13:36.523753 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:503 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:13:38.516464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:504 started Sep 04 01:13:38.518912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5745,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=911000000,duration_sec=1027,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:13:38.519619 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:13:38.519968 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:504 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:13:40.517482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:505 started Sep 04 01:13:40.519891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5747,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=911000000,duration_sec=1029,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:13:40.520454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:13:40.520805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:505 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:13:42.518582 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:506 started Sep 04 01:13:42.520956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5749,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=913000000,duration_sec=1031,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:13:42.521612 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:13:42.521952 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:506 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:13:44.519828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:507 started Sep 04 01:13:44.522591 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade574b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=914000000,duration_sec=1033,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:13:44.523164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:13:44.523517 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:507 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:13:46.521004 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:508 started Sep 04 01:13:46.523442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade574d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=915000000,duration_sec=1035,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:13:46.523994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:13:46.524339 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:508 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:13:48.522107 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:509 started Sep 04 01:13:48.524530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade574f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=916000000,duration_sec=1037,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:13:48.525101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:13:48.525462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:509 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:13:50.523118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:510 started Sep 04 01:13:50.526024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5751,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=917000000,duration_sec=1039,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:13:50.526573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:13:50.526923 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:510 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:13:51.440331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-2270a99a-0b50-4d23-950b-9f1d212a56b8 tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] Resource Port deleted: 3a4abfa2-c334-4497-99bc-b98bb52855e4 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:51.441571 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-2270a99a-0b50-4d23-950b-9f1d212a56b8 tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (3a4abfa2-c334-4497-99bc-b98bb52855e4), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:52.523636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:511 started Sep 04 01:13:52.527184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5753,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=918000000,duration_sec=1041,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:13:52.527739 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:13:52.528754 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:511 - starting polling. Elapsed:0.005 Sep 04 01:13:52.530700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:52.531869 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 3a4abfa2-c334-4497-99bc-b98bb52855e4 not present in bridge br-int Sep 04 01:13:52.532192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] net_uuid None not managed by VLAN manager Sep 04 01:13:52.532519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for ['3a4abfa2-c334-4497-99bc-b98bb52855e4'] Sep 04 01:13:52.532882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 3a4abfa2-c334-4497-99bc-b98bb52855e4 is not handled by the firewall. {{(pid=107812) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 04 01:13:52.534980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:511 - port information retrieved. Elapsed:0.012 Sep 04 01:13:52.535307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:511 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Sep 04 01:13:54.525392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:512 started Sep 04 01:13:54.527797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5755,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=919000000,duration_sec=1043,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:13:54.528404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:13:54.528841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:512 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:13:54.721540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-9b2e5874-3e87-4a71-ad9e-5cf7b81496b9 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:13:54Z,description='Default security group',id=7277393d-366d-4049-93e7-3c10553b32f1,is_default=True,name='default',project_id='fb2a8002d6bd4e7f9d2484cfd221dae2',revision_number=1,rules=[SecurityGroupRule(394bce86-0c55-463c-810d-5a5b8e367909),SecurityGroupRule(bbbd160c-4183-40e1-95eb-2047a212ffcf),SecurityGroupRule(bf4ad615-f574-4eab-a308-e66fd323e217),SecurityGroupRule(df2c8061-cf48-438f-839a-8655242051bf)],shared=False,stateful=True,updated_at=2022-09-04T01:13:54Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:54.722042 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-9b2e5874-3e87-4a71-ad9e-5cf7b81496b9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (7277393d-366d-4049-93e7-3c10553b32f1), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:54.722810 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-9b2e5874-3e87-4a71-ad9e-5cf7b81496b9 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:13:54Z,description=,direction='egress',ethertype='IPv4',id=394bce86-0c55-463c-810d-5a5b8e367909,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fb2a8002d6bd4e7f9d2484cfd221dae2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=7277393d-366d-4049-93e7-3c10553b32f1,updated_at=2022-09-04T01:13:54Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:54.723445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-9b2e5874-3e87-4a71-ad9e-5cf7b81496b9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (394bce86-0c55-463c-810d-5a5b8e367909), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:54.723841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-9b2e5874-3e87-4a71-ad9e-5cf7b81496b9 admin admin] Security group rule updated ['7277393d-366d-4049-93e7-3c10553b32f1'] Sep 04 01:13:54.724631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-9b2e5874-3e87-4a71-ad9e-5cf7b81496b9 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:13:54Z,description=,direction='egress',ethertype='IPv6',id=bbbd160c-4183-40e1-95eb-2047a212ffcf,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fb2a8002d6bd4e7f9d2484cfd221dae2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=7277393d-366d-4049-93e7-3c10553b32f1,updated_at=2022-09-04T01:13:54Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:54.725064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-9b2e5874-3e87-4a71-ad9e-5cf7b81496b9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (bbbd160c-4183-40e1-95eb-2047a212ffcf), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:54.725656 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-9b2e5874-3e87-4a71-ad9e-5cf7b81496b9 admin admin] Security group rule updated ['7277393d-366d-4049-93e7-3c10553b32f1'] Sep 04 01:13:54.726436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-9b2e5874-3e87-4a71-ad9e-5cf7b81496b9 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:13:54Z,description=,direction='ingress',ethertype='IPv4',id=bf4ad615-f574-4eab-a308-e66fd323e217,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fb2a8002d6bd4e7f9d2484cfd221dae2',protocol=,remote_address_group_id=,remote_group_id=7277393d-366d-4049-93e7-3c10553b32f1,remote_ip_prefix=,revision_number=0,security_group_id=7277393d-366d-4049-93e7-3c10553b32f1,updated_at=2022-09-04T01:13:54Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:54.727395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-9b2e5874-3e87-4a71-ad9e-5cf7b81496b9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (bf4ad615-f574-4eab-a308-e66fd323e217), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:54.727838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-9b2e5874-3e87-4a71-ad9e-5cf7b81496b9 admin admin] Security group rule updated ['7277393d-366d-4049-93e7-3c10553b32f1'] Sep 04 01:13:54.728768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-9b2e5874-3e87-4a71-ad9e-5cf7b81496b9 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:13:54Z,description=,direction='ingress',ethertype='IPv6',id=df2c8061-cf48-438f-839a-8655242051bf,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fb2a8002d6bd4e7f9d2484cfd221dae2',protocol=,remote_address_group_id=,remote_group_id=7277393d-366d-4049-93e7-3c10553b32f1,remote_ip_prefix=,revision_number=0,security_group_id=7277393d-366d-4049-93e7-3c10553b32f1,updated_at=2022-09-04T01:13:54Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:13:54.729344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-9b2e5874-3e87-4a71-ad9e-5cf7b81496b9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (df2c8061-cf48-438f-839a-8655242051bf), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:54.729686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-9b2e5874-3e87-4a71-ad9e-5cf7b81496b9 admin admin] Security group rule updated ['7277393d-366d-4049-93e7-3c10553b32f1'] Sep 04 01:13:55.001901 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-3f8ee14c-095f-43bb-806c-b0df3e33e53d admin admin] Resource SecurityGroup deleted: 7277393d-366d-4049-93e7-3c10553b32f1 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:55.001901 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-3f8ee14c-095f-43bb-806c-b0df3e33e53d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (7277393d-366d-4049-93e7-3c10553b32f1), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:55.001901 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f8ee14c-095f-43bb-806c-b0df3e33e53d admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('7277393d-366d-4049-93e7-3c10553b32f1',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:13:55.011580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-3f8ee14c-095f-43bb-806c-b0df3e33e53d admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('7277393d-366d-4049-93e7-3c10553b32f1',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:13:55.012255 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-3f8ee14c-095f-43bb-806c-b0df3e33e53d admin admin] Resource SecurityGroupRule deleted: 394bce86-0c55-463c-810d-5a5b8e367909 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:55.012872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-3f8ee14c-095f-43bb-806c-b0df3e33e53d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (394bce86-0c55-463c-810d-5a5b8e367909), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:55.013600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-3f8ee14c-095f-43bb-806c-b0df3e33e53d admin admin] Security group rule updated ['7277393d-366d-4049-93e7-3c10553b32f1'] Sep 04 01:13:55.014045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-3f8ee14c-095f-43bb-806c-b0df3e33e53d admin admin] Resource SecurityGroupRule deleted: bbbd160c-4183-40e1-95eb-2047a212ffcf {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:55.014394 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-3f8ee14c-095f-43bb-806c-b0df3e33e53d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (bbbd160c-4183-40e1-95eb-2047a212ffcf), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:55.014731 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-3f8ee14c-095f-43bb-806c-b0df3e33e53d admin admin] Security group rule updated ['7277393d-366d-4049-93e7-3c10553b32f1'] Sep 04 01:13:55.015138 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-3f8ee14c-095f-43bb-806c-b0df3e33e53d admin admin] Resource SecurityGroupRule deleted: bf4ad615-f574-4eab-a308-e66fd323e217 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:55.015478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-3f8ee14c-095f-43bb-806c-b0df3e33e53d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (bf4ad615-f574-4eab-a308-e66fd323e217), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:55.015799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-3f8ee14c-095f-43bb-806c-b0df3e33e53d admin admin] Security group rule updated ['7277393d-366d-4049-93e7-3c10553b32f1'] Sep 04 01:13:55.016212 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-3f8ee14c-095f-43bb-806c-b0df3e33e53d admin admin] Resource SecurityGroupRule deleted: df2c8061-cf48-438f-839a-8655242051bf {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:13:55.016710 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-3f8ee14c-095f-43bb-806c-b0df3e33e53d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (df2c8061-cf48-438f-839a-8655242051bf), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:13:55.017032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-3f8ee14c-095f-43bb-806c-b0df3e33e53d admin admin] Security group rule updated ['7277393d-366d-4049-93e7-3c10553b32f1'] Sep 04 01:13:56.525380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:513 started Sep 04 01:13:56.527788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5757,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=919000000,duration_sec=1045,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:13:56.528369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:13:56.528723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:513 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:13:58.525797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:514 started Sep 04 01:13:58.532382 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5759,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=920000000,duration_sec=1047,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:13:58.532950 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:13:58.533327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:514 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 04 01:13:59.025343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Resource Port d072bfcf-41bd-430e-800c-1d1a3b17d915 updated (revision_number 8->9). Old fields: {'status': 'ACTIVE'} New fields: {'status': 'DOWN'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:13:59.025731 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (d072bfcf-41bd-430e-800c-1d1a3b17d915), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:00.526531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:515 started Sep 04 01:14:00.528973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade575b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=921000000,duration_sec=1049,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:00.530167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:14:00.530500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:515 - starting polling. Elapsed:0.004 Sep 04 01:14:00.532266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:00.534423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:515 - port information retrieved. Elapsed:0.008 Sep 04 01:14:00.534754 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:515 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 04 01:14:02.175677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-53982a2a-00c1-48f4-8390-655207b0b6db tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] Resource Port deleted: d072bfcf-41bd-430e-800c-1d1a3b17d915 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:02.175677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-53982a2a-00c1-48f4-8390-655207b0b6db tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (d072bfcf-41bd-430e-800c-1d1a3b17d915), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:02.175677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-53982a2a-00c1-48f4-8390-655207b0b6db tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] Security group member updated {'270d62da-5350-44de-9262-a4399d8651e3'} Sep 04 01:14:02.527932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:516 started Sep 04 01:14:02.532350 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade575d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=923000000,duration_sec=1051,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:02.533214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:14:02.534380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:516 - starting polling. Elapsed:0.006 Sep 04 01:14:02.541715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:02.541715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port d072bfcf-41bd-430e-800c-1d1a3b17d915 not present in bridge br-int Sep 04 01:14:02.541715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] net_uuid None not managed by VLAN manager Sep 04 01:14:02.541715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for ['d072bfcf-41bd-430e-800c-1d1a3b17d915'] Sep 04 01:14:02.541715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port d072bfcf-41bd-430e-800c-1d1a3b17d915 is not handled by the firewall. {{(pid=107812) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 04 01:14:02.545542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:516 - port information retrieved. Elapsed:0.017 Sep 04 01:14:02.545979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:516 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.019 Sep 04 01:14:04.528752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:517 started Sep 04 01:14:04.531113 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade575f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=923000000,duration_sec=1053,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:04.531696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:14:04.532047 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:517 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:14:06.530237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:518 started Sep 04 01:14:06.532977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5761,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=924000000,duration_sec=1055,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:06.533580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:14:06.533933 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:518 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:14:06.632247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-a723aba4-c776-467c-b68d-2d6896536b82 tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] Resource SecurityGroup deleted: 270d62da-5350-44de-9262-a4399d8651e3 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:06.632629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-a723aba4-c776-467c-b68d-2d6896536b82 tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (270d62da-5350-44de-9262-a4399d8651e3), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:06.633232 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a723aba4-c776-467c-b68d-2d6896536b82 tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('270d62da-5350-44de-9262-a4399d8651e3',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:14:06.646483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-a723aba4-c776-467c-b68d-2d6896536b82 tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('270d62da-5350-44de-9262-a4399d8651e3',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:14:06.646964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-a723aba4-c776-467c-b68d-2d6896536b82 tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] Resource SecurityGroupRule deleted: 9c61bb4b-810a-4263-92c9-1368ff827f90 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:06.647326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-a723aba4-c776-467c-b68d-2d6896536b82 tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (9c61bb4b-810a-4263-92c9-1368ff827f90), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:06.647655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-a723aba4-c776-467c-b68d-2d6896536b82 tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] Security group rule updated ['270d62da-5350-44de-9262-a4399d8651e3'] Sep 04 01:14:06.648088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-a723aba4-c776-467c-b68d-2d6896536b82 tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] Resource SecurityGroupRule deleted: bd663084-377e-4589-9d3f-e256469835d1 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:06.648428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-a723aba4-c776-467c-b68d-2d6896536b82 tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (bd663084-377e-4589-9d3f-e256469835d1), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:06.648742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-a723aba4-c776-467c-b68d-2d6896536b82 tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] Security group rule updated ['270d62da-5350-44de-9262-a4399d8651e3'] Sep 04 01:14:06.649190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-a723aba4-c776-467c-b68d-2d6896536b82 tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] Resource SecurityGroupRule deleted: 4f7cf12d-b606-4451-9c0b-17cb4e4655db {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:06.649534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-a723aba4-c776-467c-b68d-2d6896536b82 tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (4f7cf12d-b606-4451-9c0b-17cb4e4655db), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:06.649845 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-a723aba4-c776-467c-b68d-2d6896536b82 tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] Security group rule updated ['270d62da-5350-44de-9262-a4399d8651e3'] Sep 04 01:14:06.650255 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-a723aba4-c776-467c-b68d-2d6896536b82 tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] Resource SecurityGroupRule deleted: 71660eff-3edf-4824-9433-e2af0849d0ac {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:06.650588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-a723aba4-c776-467c-b68d-2d6896536b82 tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (71660eff-3edf-4824-9433-e2af0849d0ac), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:06.650996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-a723aba4-c776-467c-b68d-2d6896536b82 tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] Security group rule updated ['270d62da-5350-44de-9262-a4399d8651e3'] Sep 04 01:14:06.651408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-a723aba4-c776-467c-b68d-2d6896536b82 tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] Resource SecurityGroupRule deleted: afe23fac-44f4-4fbc-8c58-9dc12cc0222b {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:06.651738 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-a723aba4-c776-467c-b68d-2d6896536b82 tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (afe23fac-44f4-4fbc-8c58-9dc12cc0222b), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:06.652048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-a723aba4-c776-467c-b68d-2d6896536b82 tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] Security group rule updated ['270d62da-5350-44de-9262-a4399d8651e3'] Sep 04 01:14:06.652480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-a723aba4-c776-467c-b68d-2d6896536b82 tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] Resource SecurityGroupRule deleted: d306de2e-c68c-4493-8eb3-7981adee1a7a {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:06.652812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-a723aba4-c776-467c-b68d-2d6896536b82 tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (d306de2e-c68c-4493-8eb3-7981adee1a7a), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:06.653166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-a723aba4-c776-467c-b68d-2d6896536b82 tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] Security group rule updated ['270d62da-5350-44de-9262-a4399d8651e3'] Sep 04 01:14:06.653573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-a723aba4-c776-467c-b68d-2d6896536b82 tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] Resource SecurityGroupRule deleted: 9c8fb840-8e21-4e3a-8f04-46abea003990 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:06.654442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-a723aba4-c776-467c-b68d-2d6896536b82 tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (9c8fb840-8e21-4e3a-8f04-46abea003990), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:06.655434 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-a723aba4-c776-467c-b68d-2d6896536b82 tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] Security group rule updated ['270d62da-5350-44de-9262-a4399d8651e3'] Sep 04 01:14:06.655857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-a723aba4-c776-467c-b68d-2d6896536b82 tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] Resource SecurityGroupRule deleted: 47ebbefa-cdae-49cc-a540-4c2b9dab5d28 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:06.656196 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-a723aba4-c776-467c-b68d-2d6896536b82 tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (47ebbefa-cdae-49cc-a540-4c2b9dab5d28), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:06.656510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-a723aba4-c776-467c-b68d-2d6896536b82 tempest-TestShelveInstance-193062993 tempest-TestShelveInstance-193062993-project] Security group rule updated ['270d62da-5350-44de-9262-a4399d8651e3'] Sep 04 01:14:07.315449 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4f80f6b1-523a-43e3-a77f-c98e387cfe36 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:14:07Z,description='Default security group',id=5d5fc27b-385a-4137-a9cf-a9c7fe8d803d,is_default=True,name='default',project_id='9316dc6b766147b4ac43791e2714f2e5',revision_number=1,rules=[SecurityGroupRule(2c3c39b6-7ae3-4987-938d-31a576fab1a6),SecurityGroupRule(45d5600a-4a0d-4024-a09e-071a255e855b),SecurityGroupRule(ae730f29-0b23-4808-91ee-fd52a024fcc8),SecurityGroupRule(df6cc1a5-2a55-4b83-9484-f9dd58671ff1)],shared=False,stateful=True,updated_at=2022-09-04T01:14:07Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:07.316190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4f80f6b1-523a-43e3-a77f-c98e387cfe36 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (5d5fc27b-385a-4137-a9cf-a9c7fe8d803d), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:07.316881 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4f80f6b1-523a-43e3-a77f-c98e387cfe36 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:14:07Z,description=,direction='ingress',ethertype='IPv6',id=2c3c39b6-7ae3-4987-938d-31a576fab1a6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9316dc6b766147b4ac43791e2714f2e5',protocol=,remote_address_group_id=,remote_group_id=5d5fc27b-385a-4137-a9cf-a9c7fe8d803d,remote_ip_prefix=,revision_number=0,security_group_id=5d5fc27b-385a-4137-a9cf-a9c7fe8d803d,updated_at=2022-09-04T01:14:07Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:07.317278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4f80f6b1-523a-43e3-a77f-c98e387cfe36 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (2c3c39b6-7ae3-4987-938d-31a576fab1a6), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:07.317613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-4f80f6b1-523a-43e3-a77f-c98e387cfe36 admin admin] Security group rule updated ['5d5fc27b-385a-4137-a9cf-a9c7fe8d803d'] Sep 04 01:14:07.318838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4f80f6b1-523a-43e3-a77f-c98e387cfe36 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:14:07Z,description=,direction='egress',ethertype='IPv6',id=45d5600a-4a0d-4024-a09e-071a255e855b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9316dc6b766147b4ac43791e2714f2e5',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=5d5fc27b-385a-4137-a9cf-a9c7fe8d803d,updated_at=2022-09-04T01:14:07Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:07.319449 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4f80f6b1-523a-43e3-a77f-c98e387cfe36 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (45d5600a-4a0d-4024-a09e-071a255e855b), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:07.319895 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-4f80f6b1-523a-43e3-a77f-c98e387cfe36 admin admin] Security group rule updated ['5d5fc27b-385a-4137-a9cf-a9c7fe8d803d'] Sep 04 01:14:07.320618 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4f80f6b1-523a-43e3-a77f-c98e387cfe36 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:14:07Z,description=,direction='ingress',ethertype='IPv4',id=ae730f29-0b23-4808-91ee-fd52a024fcc8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9316dc6b766147b4ac43791e2714f2e5',protocol=,remote_address_group_id=,remote_group_id=5d5fc27b-385a-4137-a9cf-a9c7fe8d803d,remote_ip_prefix=,revision_number=0,security_group_id=5d5fc27b-385a-4137-a9cf-a9c7fe8d803d,updated_at=2022-09-04T01:14:07Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:07.320969 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4f80f6b1-523a-43e3-a77f-c98e387cfe36 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (ae730f29-0b23-4808-91ee-fd52a024fcc8), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:07.321367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-4f80f6b1-523a-43e3-a77f-c98e387cfe36 admin admin] Security group rule updated ['5d5fc27b-385a-4137-a9cf-a9c7fe8d803d'] Sep 04 01:14:07.322061 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4f80f6b1-523a-43e3-a77f-c98e387cfe36 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:14:07Z,description=,direction='egress',ethertype='IPv4',id=df6cc1a5-2a55-4b83-9484-f9dd58671ff1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9316dc6b766147b4ac43791e2714f2e5',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=5d5fc27b-385a-4137-a9cf-a9c7fe8d803d,updated_at=2022-09-04T01:14:07Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:07.326577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4f80f6b1-523a-43e3-a77f-c98e387cfe36 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (df6cc1a5-2a55-4b83-9484-f9dd58671ff1), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:07.326577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-4f80f6b1-523a-43e3-a77f-c98e387cfe36 admin admin] Security group rule updated ['5d5fc27b-385a-4137-a9cf-a9c7fe8d803d'] Sep 04 01:14:07.516174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c186b841-4905-4862-80d1-f312867f0b8a admin admin] Resource SecurityGroup deleted: 5d5fc27b-385a-4137-a9cf-a9c7fe8d803d {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:07.516597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-c186b841-4905-4862-80d1-f312867f0b8a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (5d5fc27b-385a-4137-a9cf-a9c7fe8d803d), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:07.517068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c186b841-4905-4862-80d1-f312867f0b8a admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('5d5fc27b-385a-4137-a9cf-a9c7fe8d803d',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:14:07.530455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c186b841-4905-4862-80d1-f312867f0b8a admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('5d5fc27b-385a-4137-a9cf-a9c7fe8d803d',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:14:07.531110 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c186b841-4905-4862-80d1-f312867f0b8a admin admin] Resource SecurityGroupRule deleted: 2c3c39b6-7ae3-4987-938d-31a576fab1a6 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:07.531346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-c186b841-4905-4862-80d1-f312867f0b8a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (2c3c39b6-7ae3-4987-938d-31a576fab1a6), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:07.531771 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-c186b841-4905-4862-80d1-f312867f0b8a admin admin] Security group rule updated ['5d5fc27b-385a-4137-a9cf-a9c7fe8d803d'] Sep 04 01:14:07.532352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c186b841-4905-4862-80d1-f312867f0b8a admin admin] Resource SecurityGroupRule deleted: 45d5600a-4a0d-4024-a09e-071a255e855b {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:07.532742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-c186b841-4905-4862-80d1-f312867f0b8a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (45d5600a-4a0d-4024-a09e-071a255e855b), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:07.533170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-c186b841-4905-4862-80d1-f312867f0b8a admin admin] Security group rule updated ['5d5fc27b-385a-4137-a9cf-a9c7fe8d803d'] Sep 04 01:14:07.533594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c186b841-4905-4862-80d1-f312867f0b8a admin admin] Resource SecurityGroupRule deleted: ae730f29-0b23-4808-91ee-fd52a024fcc8 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:07.533972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-c186b841-4905-4862-80d1-f312867f0b8a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (ae730f29-0b23-4808-91ee-fd52a024fcc8), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:07.534296 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-c186b841-4905-4862-80d1-f312867f0b8a admin admin] Security group rule updated ['5d5fc27b-385a-4137-a9cf-a9c7fe8d803d'] Sep 04 01:14:07.534715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c186b841-4905-4862-80d1-f312867f0b8a admin admin] Resource SecurityGroupRule deleted: df6cc1a5-2a55-4b83-9484-f9dd58671ff1 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:07.537912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-c186b841-4905-4862-80d1-f312867f0b8a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (df6cc1a5-2a55-4b83-9484-f9dd58671ff1), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:07.537912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-c186b841-4905-4862-80d1-f312867f0b8a admin admin] Security group rule updated ['5d5fc27b-385a-4137-a9cf-a9c7fe8d803d'] Sep 04 01:14:08.265244 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-5a760214-11e1-445f-901f-cb0b214dbd47 admin admin] Resource Port deleted: 9db3ca9e-27d3-4852-b8c6-3fc745d2d055 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:08.266966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-5a760214-11e1-445f-901f-cb0b214dbd47 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (9db3ca9e-27d3-4852-b8c6-3fc745d2d055), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:08.531048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:519 started Sep 04 01:14:08.533549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5763,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=925000000,duration_sec=1057,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:08.534124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:14:08.534460 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:519 - starting polling. Elapsed:0.004 Sep 04 01:14:08.536240 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:08.547385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-9db3ca9e-27, col_values=(('tag', 4095),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:08.547385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade5765,OFPFlowMod(buffer_id=4294967295,command=0,cookie=6887031442322345889,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 23}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:08.547648 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for ['9db3ca9e-27d3-4852-b8c6-3fc745d2d055'] Sep 04 01:14:08.548172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 4 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:14:08.600723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb04877c-f313-46b5-a9fd-008e78a835b3]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:14:08.604313 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:519 - port information retrieved. Elapsed:0.073 Sep 04 01:14:08.605161 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:519 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.074 Sep 04 01:14:08.798483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-5d21c11a-e02e-4405-a3ad-a5a58feb8a14 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:14:08Z,description='Default security group',id=001f418d-9847-4ab8-b278-951d1f72169c,is_default=True,name='default',project_id='66afded63f464752aa18426be3a437ac',revision_number=1,rules=[SecurityGroupRule(0cab68eb-1960-4d8e-a968-85c21139b8c1),SecurityGroupRule(343bdaac-4852-46f9-93ae-003b5f0ff45e),SecurityGroupRule(ceb9b728-224a-4f2c-8aca-3816523bcf49),SecurityGroupRule(dbcffb81-c41b-427b-8445-973cf8ba6e4a)],shared=False,stateful=True,updated_at=2022-09-04T01:14:08Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:08.798877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-5d21c11a-e02e-4405-a3ad-a5a58feb8a14 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (001f418d-9847-4ab8-b278-951d1f72169c), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:08.799541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-5d21c11a-e02e-4405-a3ad-a5a58feb8a14 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:14:08Z,description=,direction='ingress',ethertype='IPv6',id=0cab68eb-1960-4d8e-a968-85c21139b8c1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='66afded63f464752aa18426be3a437ac',protocol=,remote_address_group_id=,remote_group_id=001f418d-9847-4ab8-b278-951d1f72169c,remote_ip_prefix=,revision_number=0,security_group_id=001f418d-9847-4ab8-b278-951d1f72169c,updated_at=2022-09-04T01:14:08Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:08.799910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-5d21c11a-e02e-4405-a3ad-a5a58feb8a14 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (0cab68eb-1960-4d8e-a968-85c21139b8c1), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:08.800247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-5d21c11a-e02e-4405-a3ad-a5a58feb8a14 admin admin] Security group rule updated ['001f418d-9847-4ab8-b278-951d1f72169c'] Sep 04 01:14:08.800991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-5d21c11a-e02e-4405-a3ad-a5a58feb8a14 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:14:08Z,description=,direction='egress',ethertype='IPv4',id=343bdaac-4852-46f9-93ae-003b5f0ff45e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='66afded63f464752aa18426be3a437ac',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=001f418d-9847-4ab8-b278-951d1f72169c,updated_at=2022-09-04T01:14:08Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:08.801376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-5d21c11a-e02e-4405-a3ad-a5a58feb8a14 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (343bdaac-4852-46f9-93ae-003b5f0ff45e), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:08.801706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-5d21c11a-e02e-4405-a3ad-a5a58feb8a14 admin admin] Security group rule updated ['001f418d-9847-4ab8-b278-951d1f72169c'] Sep 04 01:14:08.802417 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-5d21c11a-e02e-4405-a3ad-a5a58feb8a14 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:14:08Z,description=,direction='ingress',ethertype='IPv4',id=ceb9b728-224a-4f2c-8aca-3816523bcf49,normalized_cidr=None,port_range_max=,port_range_min=,project_id='66afded63f464752aa18426be3a437ac',protocol=,remote_address_group_id=,remote_group_id=001f418d-9847-4ab8-b278-951d1f72169c,remote_ip_prefix=,revision_number=0,security_group_id=001f418d-9847-4ab8-b278-951d1f72169c,updated_at=2022-09-04T01:14:08Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:08.802772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-5d21c11a-e02e-4405-a3ad-a5a58feb8a14 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (ceb9b728-224a-4f2c-8aca-3816523bcf49), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:08.803099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-5d21c11a-e02e-4405-a3ad-a5a58feb8a14 admin admin] Security group rule updated ['001f418d-9847-4ab8-b278-951d1f72169c'] Sep 04 01:14:08.803796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-5d21c11a-e02e-4405-a3ad-a5a58feb8a14 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:14:08Z,description=,direction='egress',ethertype='IPv6',id=dbcffb81-c41b-427b-8445-973cf8ba6e4a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='66afded63f464752aa18426be3a437ac',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=001f418d-9847-4ab8-b278-951d1f72169c,updated_at=2022-09-04T01:14:08Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:08.804351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-5d21c11a-e02e-4405-a3ad-a5a58feb8a14 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (dbcffb81-c41b-427b-8445-973cf8ba6e4a), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:08.804859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-5d21c11a-e02e-4405-a3ad-a5a58feb8a14 admin admin] Security group rule updated ['001f418d-9847-4ab8-b278-951d1f72169c'] Sep 04 01:14:09.043035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-ffa61dab-a203-4ef6-99fc-6165e192b0d3 admin admin] Resource SecurityGroup deleted: 001f418d-9847-4ab8-b278-951d1f72169c {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:09.044049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-ffa61dab-a203-4ef6-99fc-6165e192b0d3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (001f418d-9847-4ab8-b278-951d1f72169c), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:09.044820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffa61dab-a203-4ef6-99fc-6165e192b0d3 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('001f418d-9847-4ab8-b278-951d1f72169c',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:14:09.061595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-ffa61dab-a203-4ef6-99fc-6165e192b0d3 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('001f418d-9847-4ab8-b278-951d1f72169c',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:14:09.062421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-ffa61dab-a203-4ef6-99fc-6165e192b0d3 admin admin] Resource SecurityGroupRule deleted: 0cab68eb-1960-4d8e-a968-85c21139b8c1 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:09.063071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-ffa61dab-a203-4ef6-99fc-6165e192b0d3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (0cab68eb-1960-4d8e-a968-85c21139b8c1), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:09.063614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-ffa61dab-a203-4ef6-99fc-6165e192b0d3 admin admin] Security group rule updated ['001f418d-9847-4ab8-b278-951d1f72169c'] Sep 04 01:14:09.064253 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-ffa61dab-a203-4ef6-99fc-6165e192b0d3 admin admin] Resource SecurityGroupRule deleted: 343bdaac-4852-46f9-93ae-003b5f0ff45e {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:09.064814 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-ffa61dab-a203-4ef6-99fc-6165e192b0d3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (343bdaac-4852-46f9-93ae-003b5f0ff45e), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:09.065427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-ffa61dab-a203-4ef6-99fc-6165e192b0d3 admin admin] Security group rule updated ['001f418d-9847-4ab8-b278-951d1f72169c'] Sep 04 01:14:09.066176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-ffa61dab-a203-4ef6-99fc-6165e192b0d3 admin admin] Resource SecurityGroupRule deleted: ceb9b728-224a-4f2c-8aca-3816523bcf49 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:09.066736 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-ffa61dab-a203-4ef6-99fc-6165e192b0d3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (ceb9b728-224a-4f2c-8aca-3816523bcf49), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:09.067458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-ffa61dab-a203-4ef6-99fc-6165e192b0d3 admin admin] Security group rule updated ['001f418d-9847-4ab8-b278-951d1f72169c'] Sep 04 01:14:09.068863 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-ffa61dab-a203-4ef6-99fc-6165e192b0d3 admin admin] Resource SecurityGroupRule deleted: dbcffb81-c41b-427b-8445-973cf8ba6e4a {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:09.069490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-ffa61dab-a203-4ef6-99fc-6165e192b0d3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (dbcffb81-c41b-427b-8445-973cf8ba6e4a), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:09.070233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-ffa61dab-a203-4ef6-99fc-6165e192b0d3 admin admin] Security group rule updated ['001f418d-9847-4ab8-b278-951d1f72169c'] Sep 04 01:14:09.116666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-11a59eb1-46d6-49cd-b57c-46214c048560 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:14:08Z,description='Default security group',id=76caf30c-8da1-44c1-bbaa-626b44c17c1d,is_default=True,name='default',project_id='027792a6118140099aaf522ca15bb07e',revision_number=1,rules=[SecurityGroupRule(04c99dff-8057-4beb-923e-45c5b9100501),SecurityGroupRule(b2ac7312-fba5-4a73-9f77-2e661f771820),SecurityGroupRule(e31ed291-e631-4a00-bff9-1898ccc6da9b),SecurityGroupRule(e9fa14f9-ccc2-46e0-a8dc-217bc663cee3)],shared=False,stateful=True,updated_at=2022-09-04T01:14:08Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:09.117050 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-11a59eb1-46d6-49cd-b57c-46214c048560 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (76caf30c-8da1-44c1-bbaa-626b44c17c1d), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:09.117720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-11a59eb1-46d6-49cd-b57c-46214c048560 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:14:08Z,description=,direction='egress',ethertype='IPv4',id=04c99dff-8057-4beb-923e-45c5b9100501,normalized_cidr=None,port_range_max=,port_range_min=,project_id='027792a6118140099aaf522ca15bb07e',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=76caf30c-8da1-44c1-bbaa-626b44c17c1d,updated_at=2022-09-04T01:14:08Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:09.118077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-11a59eb1-46d6-49cd-b57c-46214c048560 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (04c99dff-8057-4beb-923e-45c5b9100501), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:09.118839 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-11a59eb1-46d6-49cd-b57c-46214c048560 admin admin] Security group rule updated ['76caf30c-8da1-44c1-bbaa-626b44c17c1d'] Sep 04 01:14:09.119547 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-11a59eb1-46d6-49cd-b57c-46214c048560 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:14:08Z,description=,direction='egress',ethertype='IPv6',id=b2ac7312-fba5-4a73-9f77-2e661f771820,normalized_cidr=None,port_range_max=,port_range_min=,project_id='027792a6118140099aaf522ca15bb07e',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=76caf30c-8da1-44c1-bbaa-626b44c17c1d,updated_at=2022-09-04T01:14:08Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:09.119929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-11a59eb1-46d6-49cd-b57c-46214c048560 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (b2ac7312-fba5-4a73-9f77-2e661f771820), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:09.120254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-11a59eb1-46d6-49cd-b57c-46214c048560 admin admin] Security group rule updated ['76caf30c-8da1-44c1-bbaa-626b44c17c1d'] Sep 04 01:14:09.121102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-11a59eb1-46d6-49cd-b57c-46214c048560 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:14:08Z,description=,direction='ingress',ethertype='IPv4',id=e31ed291-e631-4a00-bff9-1898ccc6da9b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='027792a6118140099aaf522ca15bb07e',protocol=,remote_address_group_id=,remote_group_id=76caf30c-8da1-44c1-bbaa-626b44c17c1d,remote_ip_prefix=,revision_number=0,security_group_id=76caf30c-8da1-44c1-bbaa-626b44c17c1d,updated_at=2022-09-04T01:14:08Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:09.121463 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-11a59eb1-46d6-49cd-b57c-46214c048560 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (e31ed291-e631-4a00-bff9-1898ccc6da9b), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:09.125490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-11a59eb1-46d6-49cd-b57c-46214c048560 admin admin] Security group rule updated ['76caf30c-8da1-44c1-bbaa-626b44c17c1d'] Sep 04 01:14:09.127223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-11a59eb1-46d6-49cd-b57c-46214c048560 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:14:08Z,description=,direction='ingress',ethertype='IPv6',id=e9fa14f9-ccc2-46e0-a8dc-217bc663cee3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='027792a6118140099aaf522ca15bb07e',protocol=,remote_address_group_id=,remote_group_id=76caf30c-8da1-44c1-bbaa-626b44c17c1d,remote_ip_prefix=,revision_number=0,security_group_id=76caf30c-8da1-44c1-bbaa-626b44c17c1d,updated_at=2022-09-04T01:14:08Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:09.127874 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-11a59eb1-46d6-49cd-b57c-46214c048560 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (e9fa14f9-ccc2-46e0-a8dc-217bc663cee3), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:09.130205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-11a59eb1-46d6-49cd-b57c-46214c048560 admin admin] Security group rule updated ['76caf30c-8da1-44c1-bbaa-626b44c17c1d'] Sep 04 01:14:09.433534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-11a59eb1-46d6-49cd-b57c-46214c048560 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-04T01:14:09Z,description='',dns_domain=None,id=93fca803-def7-462d-b519-0eb07f4ac511,mtu=1500,name='tempest-TestMinimumBasicScenario-749699042-network',project_id='027792a6118140099aaf522ca15bb07e',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(93fca803-def7-462d-b519-0eb07f4ac511),segments=[NetworkSegment(bb3f529c-5ae7-4cc5-a11f-2074c23f8407)],shared=False,status='ACTIVE',updated_at=2022-09-04T01:14:09Z,vlan_transparent=) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:09.435095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-11a59eb1-46d6-49cd-b57c-46214c048560 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533'] for Network (93fca803-def7-462d-b519-0eb07f4ac511), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:09.540579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["2b42f268-c29f-4d98-b759-7a7107dd05d6","delete","qr-9db3ca9e-27",23,["map",[["attached-mac","fa:16:3e:50:56:80"],["iface-id","9db3ca9e-27d3-4852-b8c6-3fc745d2d055"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:14:09.543351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager [None req-11a59eb1-46d6-49cd-b57c-46214c048560 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 93fca803-def7-462d-b519-0eb07f4ac511 with segmentation id not found. Sep 04 01:14:09.543351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 04 01:14:09.543351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 04 01:14:09.543351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 04 01:14:09.543351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 04 01:14:09.543351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 04 01:14:09.543351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 04 01:14:09.543351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 04 01:14:09.543351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 04 01:14:09.543351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 04 01:14:09.543351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 04 01:14:09.543351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 04 01:14:09.543351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 04 01:14:09.544916 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 04 01:14:09.544916 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 04 01:14:09.544916 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 04 01:14:09.544916 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 93fca803-def7-462d-b519-0eb07f4ac511 with segmentation id not found. Sep 04 01:14:09.544916 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager Sep 04 01:14:09.794015 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-24e3b0ca-513b-4dfd-99b9-c47fb8290cd0 admin admin] Resource Port deleted: e507db86-47c3-4953-96bb-c5e552b4f602 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:09.794605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-24e3b0ca-513b-4dfd-99b9-c47fb8290cd0 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (e507db86-47c3-4953-96bb-c5e552b4f602), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:09.936780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["ab80ce52-db12-4072-840d-a8de32f0af16","delete","qg-e507db86-47",22,["map",[["attached-mac","fa:16:3e:14:e3:97"],["iface-id","e507db86-47c3-4953-96bb-c5e552b4f602"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:14:09.940692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-eea414db-77d3-4c64-bf16-1b592345b835 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(9ae83e83-259b-403a-9bee-a3c16979bdee)],cidr=172.20.0.0/28,created_at=2022-09-04T01:14:09Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=231765c8-800c-4149-b414-9dbe7bc03304,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-TestMinimumBasicScenario-749699042-subnet',network_id=93fca803-def7-462d-b519-0eb07f4ac511,project_id='027792a6118140099aaf522ca15bb07e',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-04T01:14:09Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:09.943419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-eea414db-77d3-4c64-bf16-1b592345b835 admin admin] Publish callbacks [] for Subnet (231765c8-800c-4149-b414-9dbe7bc03304), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:10.198134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-40b4a197-c7c4-42c3-8b34-7ee0a2884b35 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:14:09Z,description='Default security group',id=ecdcf72a-089d-482a-b405-420aa577a228,is_default=True,name='default',project_id='da3cd3ece2bf4885892aa6b2afdbd787',revision_number=1,rules=[SecurityGroupRule(067cdba9-203c-4d93-acf3-300f2a88a180),SecurityGroupRule(5bdfdbad-95ef-4d75-b948-d6959216f41d),SecurityGroupRule(97725451-7021-4b8b-9a54-489ae3b1c243),SecurityGroupRule(a3d2dcb6-4b75-436a-b794-7ef984891523)],shared=False,stateful=True,updated_at=2022-09-04T01:14:09Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:10.198134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-40b4a197-c7c4-42c3-8b34-7ee0a2884b35 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (ecdcf72a-089d-482a-b405-420aa577a228), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:10.198664 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-40b4a197-c7c4-42c3-8b34-7ee0a2884b35 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:14:09Z,description=,direction='ingress',ethertype='IPv4',id=067cdba9-203c-4d93-acf3-300f2a88a180,normalized_cidr=None,port_range_max=,port_range_min=,project_id='da3cd3ece2bf4885892aa6b2afdbd787',protocol=,remote_address_group_id=,remote_group_id=ecdcf72a-089d-482a-b405-420aa577a228,remote_ip_prefix=,revision_number=0,security_group_id=ecdcf72a-089d-482a-b405-420aa577a228,updated_at=2022-09-04T01:14:09Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:10.198907 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-40b4a197-c7c4-42c3-8b34-7ee0a2884b35 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (067cdba9-203c-4d93-acf3-300f2a88a180), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:10.199422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-40b4a197-c7c4-42c3-8b34-7ee0a2884b35 admin admin] Security group rule updated ['ecdcf72a-089d-482a-b405-420aa577a228'] Sep 04 01:14:10.200509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-40b4a197-c7c4-42c3-8b34-7ee0a2884b35 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:14:10Z,description=,direction='ingress',ethertype='IPv6',id=5bdfdbad-95ef-4d75-b948-d6959216f41d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='da3cd3ece2bf4885892aa6b2afdbd787',protocol=,remote_address_group_id=,remote_group_id=ecdcf72a-089d-482a-b405-420aa577a228,remote_ip_prefix=,revision_number=0,security_group_id=ecdcf72a-089d-482a-b405-420aa577a228,updated_at=2022-09-04T01:14:10Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:10.200977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-40b4a197-c7c4-42c3-8b34-7ee0a2884b35 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (5bdfdbad-95ef-4d75-b948-d6959216f41d), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:10.201335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-40b4a197-c7c4-42c3-8b34-7ee0a2884b35 admin admin] Security group rule updated ['ecdcf72a-089d-482a-b405-420aa577a228'] Sep 04 01:14:10.202132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-40b4a197-c7c4-42c3-8b34-7ee0a2884b35 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:14:10Z,description=,direction='egress',ethertype='IPv6',id=97725451-7021-4b8b-9a54-489ae3b1c243,normalized_cidr=None,port_range_max=,port_range_min=,project_id='da3cd3ece2bf4885892aa6b2afdbd787',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ecdcf72a-089d-482a-b405-420aa577a228,updated_at=2022-09-04T01:14:10Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:10.202483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-40b4a197-c7c4-42c3-8b34-7ee0a2884b35 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (97725451-7021-4b8b-9a54-489ae3b1c243), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:10.202818 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-40b4a197-c7c4-42c3-8b34-7ee0a2884b35 admin admin] Security group rule updated ['ecdcf72a-089d-482a-b405-420aa577a228'] Sep 04 01:14:10.203506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-40b4a197-c7c4-42c3-8b34-7ee0a2884b35 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:14:09Z,description=,direction='egress',ethertype='IPv4',id=a3d2dcb6-4b75-436a-b794-7ef984891523,normalized_cidr=None,port_range_max=,port_range_min=,project_id='da3cd3ece2bf4885892aa6b2afdbd787',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ecdcf72a-089d-482a-b405-420aa577a228,updated_at=2022-09-04T01:14:09Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:10.203853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-40b4a197-c7c4-42c3-8b34-7ee0a2884b35 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (a3d2dcb6-4b75-436a-b794-7ef984891523), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:10.204177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-40b4a197-c7c4-42c3-8b34-7ee0a2884b35 admin admin] Security group rule updated ['ecdcf72a-089d-482a-b405-420aa577a228'] Sep 04 01:14:10.459963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-a217829b-c4e0-49ef-b922-c59658062b64 admin admin] Resource SecurityGroup deleted: ecdcf72a-089d-482a-b405-420aa577a228 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:10.460780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-a217829b-c4e0-49ef-b922-c59658062b64 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (ecdcf72a-089d-482a-b405-420aa577a228), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:10.461379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a217829b-c4e0-49ef-b922-c59658062b64 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('ecdcf72a-089d-482a-b405-420aa577a228',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:14:10.484988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-a217829b-c4e0-49ef-b922-c59658062b64 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('ecdcf72a-089d-482a-b405-420aa577a228',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:14:10.485921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-a217829b-c4e0-49ef-b922-c59658062b64 admin admin] Resource SecurityGroupRule deleted: 067cdba9-203c-4d93-acf3-300f2a88a180 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:10.486450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-a217829b-c4e0-49ef-b922-c59658062b64 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (067cdba9-203c-4d93-acf3-300f2a88a180), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:10.486971 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-a217829b-c4e0-49ef-b922-c59658062b64 admin admin] Security group rule updated ['ecdcf72a-089d-482a-b405-420aa577a228'] Sep 04 01:14:10.487579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-a217829b-c4e0-49ef-b922-c59658062b64 admin admin] Resource SecurityGroupRule deleted: 5bdfdbad-95ef-4d75-b948-d6959216f41d {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:10.488121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-a217829b-c4e0-49ef-b922-c59658062b64 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (5bdfdbad-95ef-4d75-b948-d6959216f41d), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:10.488640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-a217829b-c4e0-49ef-b922-c59658062b64 admin admin] Security group rule updated ['ecdcf72a-089d-482a-b405-420aa577a228'] Sep 04 01:14:10.489287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-a217829b-c4e0-49ef-b922-c59658062b64 admin admin] Resource SecurityGroupRule deleted: 97725451-7021-4b8b-9a54-489ae3b1c243 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:10.491758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-a217829b-c4e0-49ef-b922-c59658062b64 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (97725451-7021-4b8b-9a54-489ae3b1c243), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:10.492252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-a217829b-c4e0-49ef-b922-c59658062b64 admin admin] Security group rule updated ['ecdcf72a-089d-482a-b405-420aa577a228'] Sep 04 01:14:10.492839 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-a217829b-c4e0-49ef-b922-c59658062b64 admin admin] Resource SecurityGroupRule deleted: a3d2dcb6-4b75-436a-b794-7ef984891523 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:10.493855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-a217829b-c4e0-49ef-b922-c59658062b64 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (a3d2dcb6-4b75-436a-b794-7ef984891523), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:10.494628 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-a217829b-c4e0-49ef-b922-c59658062b64 admin admin] Security group rule updated ['ecdcf72a-089d-482a-b405-420aa577a228'] Sep 04 01:14:10.531609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:520 started Sep 04 01:14:10.542024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5767,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=926000000,duration_sec=1059,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:10.543965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:14:10.543965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:520 - starting polling. Elapsed:0.012 Sep 04 01:14:10.548167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:10.556730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade5769,OFPFlowMod(buffer_id=4294967295,command=3,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 22}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:10.561859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade576b,OFPFlowMod(buffer_id=4294967295,command=3,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 23}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:10.562394 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:520 - port information retrieved. Elapsed:0.031 Sep 04 01:14:10.562886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Starting to process devices in:{'current': {'da545e71-9e15-495e-b08a-2c36ede84742', '3fa24970-97a7-4f46-ac55-0b24323fa402', '89aa06b4-bbf1-40c2-bb48-500c3aecdf48', '68e4df44-e581-4fa1-922b-1b78021d5d7b', '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', 'b4f93563-ff7a-44c4-96a1-87f6e4348648', 'f0af75e4-63aa-44d3-bff7-973c3caf9bf9', 'ca102ce7-433c-4029-aabf-33d944165ff1'}, 'added': set(), 'removed': {'9db3ca9e-27d3-4852-b8c6-3fc745d2d055', 'e507db86-47c3-4953-96bb-c5e552b4f602'}, 'updated': set(), 're_added': set()} {{(pid=107812) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 04 01:14:10.563388 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:520 - agent port security group processed in 0.000 Sep 04 01:14:10.564946 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Configuration for devices up [] and devices down [] completed. Sep 04 01:14:10.565298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for {'9db3ca9e-27d3-4852-b8c6-3fc745d2d055', 'e507db86-47c3-4953-96bb-c5e552b4f602'} Sep 04 01:14:10.565791 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 9db3ca9e-27d3-4852-b8c6-3fc745d2d055 is not handled by the firewall. {{(pid=107812) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 04 01:14:10.566532 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 4 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:14:10.608055 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-75246bb3-a9bc-40a7-a40a-591812e3703b admin admin] Resource Subnet deleted: 7ab2e9dc-328d-4fbf-b70b-2170fdc1a3db {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:10.608605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-75246bb3-a9bc-40a7-a40a-591812e3703b admin admin] Publish callbacks [] for Subnet (7ab2e9dc-328d-4fbf-b70b-2170fdc1a3db), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:10.639287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[a874c0cd-6c22-4ee8-a9cb-7c2d6732ea12]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:14:10.639940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Ports {'9db3ca9e-27d3-4852-b8c6-3fc745d2d055', 'e507db86-47c3-4953-96bb-c5e552b4f602'} removed Sep 04 01:14:10.717221 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port removal failed for set() {{(pid=107812) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 04 01:14:10.717589 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] net_uuid None not managed by VLAN manager Sep 04 01:14:10.718085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:520 - treat_devices_removed completed in 0.153 Sep 04 01:14:10.718233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:520 - ports processed. Elapsed:0.187 Sep 04 01:14:10.718560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:520 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 2}}. Elapsed:0.187 Sep 04 01:14:10.816914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-deb9bf8d-9869-4f63-8f7d-7fc93746f0a7 None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:14:10Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-93fca803-def7-462d-b519-0eb07f4ac511',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=5f5b2b5c-f8bd-4ca8-94f2-f4d5e3a6444d,mac_address=fa:16:3e:e3:22:a0,name='',network_id=93fca803-def7-462d-b519-0eb07f4ac511,numa_affinity_policy=,project_id='027792a6118140099aaf522ca15bb07e',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(5f5b2b5c-f8bd-4ca8-94f2-f4d5e3a6444d),security_group_ids=set([]),status='DOWN',updated_at=2022-09-04T01:14:10Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:10.817729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-deb9bf8d-9869-4f63-8f7d-7fc93746f0a7 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (5f5b2b5c-f8bd-4ca8-94f2-f4d5e3a6444d), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:10.855409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["38bd789f-d27a-428e-a16e-7d526d7237d4","delete","tap68e4df44-e5",21,["map",[["attached-mac","fa:16:3e:8b:df:40"],["iface-id","68e4df44-e581-4fa1-922b-1b78021d5d7b"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:14:11.066877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-23840ecb-044b-477b-a3bd-c27454e70e8e admin admin] Resource Port deleted: 68e4df44-e581-4fa1-922b-1b78021d5d7b {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:11.067389 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-23840ecb-044b-477b-a3bd-c27454e70e8e admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (68e4df44-e581-4fa1-922b-1b78021d5d7b), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:11.229789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-deb9bf8d-9869-4f63-8f7d-7fc93746f0a7 None None] Resource Port 5f5b2b5c-f8bd-4ca8-94f2-f4d5e3a6444d updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=5f5b2b5c-f8bd-4ca8-94f2-f4d5e3a6444d,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=5f5b2b5c-f8bd-4ca8-94f2-f4d5e3a6444d,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=5f5b2b5c-f8bd-4ca8-94f2-f4d5e3a6444d,segment=NetworkSegment(bb3f529c-5ae7-4cc5-a11f-2074c23f8407),segment_id=bb3f529c-5ae7-4cc5-a11f-2074c23f8407)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:14:11.230458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-deb9bf8d-9869-4f63-8f7d-7fc93746f0a7 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (5f5b2b5c-f8bd-4ca8-94f2-f4d5e3a6444d), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:11.293362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c4bdfacf-6030-427f-9bc8-8d302006012b None None] Resource Port deleted: 68e4df44-e581-4fa1-922b-1b78021d5d7b {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:11.293701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c4bdfacf-6030-427f-9bc8-8d302006012b None None] Skipped duplicate delete event for 68e4df44-e581-4fa1-922b-1b78021d5d7b {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:209}} Sep 04 01:14:11.428574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["08226bc2-98a5-4b5f-b2cb-50abb5430cd2","insert","tap5f5b2b5c-f8",["set",[]],["map",[["attached-mac","fa:16:3e:e3:22:a0"],["iface-id","5f5b2b5c-f8bd-4ca8-94f2-f4d5e3a6444d"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:14:11.459724 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["08226bc2-98a5-4b5f-b2cb-50abb5430cd2","old",null,["set",[]],null],["","new","tap5f5b2b5c-f8",27,["map",[["attached-mac","fa:16:3e:e3:22:a0"],["iface-id","5f5b2b5c-f8bd-4ca8-94f2-f4d5e3a6444d"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:14:11.502633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-23840ecb-044b-477b-a3bd-c27454e70e8e admin admin] Resource Network deleted: a4020194-c9cd-46d3-9c56-5d8c215c248f {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:11.503299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-23840ecb-044b-477b-a3bd-c27454e70e8e admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533'] for Network (a4020194-c9cd-46d3-9c56-5d8c215c248f), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:11.700037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-18ca3c02-9b90-4c64-9b5c-ec226499a6e3 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:14:11Z,data_plane_status=None,description='',device_id='54174312-f04b-4db8-8dc3-1c58848b0d5e',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=e7120691-3bea-4fb5-9cd0-62e18c24380d,mac_address=fa:16:3e:f7:3f:6e,name='',network_id=e8e0564a-d5c9-4fe0-b2d4-538f45096708,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(e7120691-3bea-4fb5-9cd0-62e18c24380d),security_group_ids=set([]),status='DOWN',updated_at=2022-09-04T01:14:11Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:11.702647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-18ca3c02-9b90-4c64-9b5c-ec226499a6e3 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (e7120691-3bea-4fb5-9cd0-62e18c24380d), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:12.539947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:521 started Sep 04 01:14:12.539947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade576d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=927000000,duration_sec=1061,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:12.539947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:14:12.539947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:521 - starting polling. Elapsed:0.005 Sep 04 01:14:12.540424 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:12.544241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade576f,OFPFlowMod(buffer_id=4294967295,command=3,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 21}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:12.544865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:521 - port information retrieved. Elapsed:0.013 Sep 04 01:14:12.545326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Starting to process devices in:{'current': {'da545e71-9e15-495e-b08a-2c36ede84742', '3fa24970-97a7-4f46-ac55-0b24323fa402', '89aa06b4-bbf1-40c2-bb48-500c3aecdf48', '5f5b2b5c-f8bd-4ca8-94f2-f4d5e3a6444d', '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', 'b4f93563-ff7a-44c4-96a1-87f6e4348648', 'f0af75e4-63aa-44d3-bff7-973c3caf9bf9', 'ca102ce7-433c-4029-aabf-33d944165ff1'}, 'added': {'5f5b2b5c-f8bd-4ca8-94f2-f4d5e3a6444d'}, 'removed': {'68e4df44-e581-4fa1-922b-1b78021d5d7b'}, 'updated': {'5f5b2b5c-f8bd-4ca8-94f2-f4d5e3a6444d'}, 're_added': set()} {{(pid=107812) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 04 01:14:12.546018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': '5f5b2b5c-f8bd-4ca8-94f2-f4d5e3a6444d', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-93fca803-def7-462d-b519-0eb07f4ac511', 'network_id': '93fca803-def7-462d-b519-0eb07f4ac511', 'port_id': '5f5b2b5c-f8bd-4ca8-94f2-f4d5e3a6444d', 'mac_address': 'fa:16:3e:e3:22:a0', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 189, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '231765c8-800c-4149-b414-9dbe7bc03304', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 01:14:12.547991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: 5f5b2b5c-f8bd-4ca8-94f2-f4d5e3a6444d {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:14:12.548716 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 5f5b2b5c-f8bd-4ca8-94f2-f4d5e3a6444d updated. Details: {'device': '5f5b2b5c-f8bd-4ca8-94f2-f4d5e3a6444d', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-93fca803-def7-462d-b519-0eb07f4ac511', 'network_id': '93fca803-def7-462d-b519-0eb07f4ac511', 'port_id': '5f5b2b5c-f8bd-4ca8-94f2-f4d5e3a6444d', 'mac_address': 'fa:16:3e:e3:22:a0', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 189, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '231765c8-800c-4149-b414-9dbe7bc03304', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Sep 04 01:14:12.549227 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Assigning 11 as local vlan for net-id=93fca803-def7-462d-b519-0eb07f4ac511, seg-id=189 Sep 04 01:14:12.553226 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0x1fd38c0b,OFPFlowMod(buffer_id=4294967295,command=0,cookie=6561907047025962751,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4285), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4107}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:12.555700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0xeade5771,OFPFlowMod(buffer_id=4294967295,command=0,cookie=6887031442322345889,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4107)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4285}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:12.556911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap5f5b2b5c-f8, col_values=(('tag', 11),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:12.557602 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap5f5b2b5c-f8, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:12.558228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap5f5b2b5c-f8, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:12.567235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap5f5b2b5c-f8, col_values=(('other_config', {'net_uuid': '93fca803-def7-462d-b519-0eb07f4ac511', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '11', 'segmentation_id': '189'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:12.587177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade5773,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 27}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:12.587902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:521 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 8 devices currently available. Time elapsed: 0.042 Sep 04 01:14:12.588641 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Preparing device filters for 1 new devices {{(pid=107812) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 04 01:14:12.589322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Preparing filters for devices {'5f5b2b5c-f8bd-4ca8-94f2-f4d5e3a6444d'} Sep 04 01:14:12.590989 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information for ports dict_keys([]) {{(pid=107812) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 04 01:14:12.592085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information {{(pid=107812) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 04 01:14:12.602951 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 2 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:14:12.636464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-83d4bc7a-18ba-40c4-8041-47397494de7d admin admin] Resource Port deleted: f0af75e4-63aa-44d3-bff7-973c3caf9bf9 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:12.636943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-83d4bc7a-18ba-40c4-8041-47397494de7d admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (f0af75e4-63aa-44d3-bff7-973c3caf9bf9), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:12.686847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f9dc4a5-610d-4f5b-94dc-320cfdc885b2]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:14:12.688063 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:521 - agent port security group processed in 0.142 Sep 04 01:14:12.688562 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for 5f5b2b5c-f8bd-4ca8-94f2-f4d5e3a6444d to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 01:14:12.865899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-f5b4ed3c-e2af-4faf-8e67-870df8b5f8aa None None] Resource Port 5f5b2b5c-f8bd-4ca8-94f2-f4d5e3a6444d updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:14:12.865899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-f5b4ed3c-e2af-4faf-8e67-870df8b5f8aa None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (5f5b2b5c-f8bd-4ca8-94f2-f4d5e3a6444d), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:13.060723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Configuration for devices up ['5f5b2b5c-f8bd-4ca8-94f2-f4d5e3a6444d'] and devices down [] completed. Sep 04 01:14:13.061431 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for {'68e4df44-e581-4fa1-922b-1b78021d5d7b'} Sep 04 01:14:13.062071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 4 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:14:13.151845 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[420942b2-c881-41ea-b50a-8ac71c18c371]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:14:13.152603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Ports {'68e4df44-e581-4fa1-922b-1b78021d5d7b'} removed Sep 04 01:14:13.375080 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port removal failed for set() {{(pid=107812) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 04 01:14:13.376821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Reclaiming vlan = 9 from net-id = a4020194-c9cd-46d3-9c56-5d8c215c248f, seg-id = 176 Sep 04 01:14:13.392788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x1fd38c0d,OFPFlowMod(buffer_id=4294967295,command=3,cookie=6561907047025962751,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4105}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:13.400268 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xeade5775,OFPFlowMod(buffer_id=4294967295,command=3,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4272}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:13.400942 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:521 - treat_devices_removed completed in 0.340 Sep 04 01:14:13.401608 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:521 - ports processed. Elapsed:0.869 Sep 04 01:14:13.402239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:521 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 1}}. Elapsed:0.870 Sep 04 01:14:14.132113 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-1dfe509f-fc6a-4c60-ba02-b59ea15e9cd0 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:14:13Z,data_plane_status=None,description='',device_id='54174312-f04b-4db8-8dc3-1c58848b0d5e',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=7f2856e4-8bb1-4647-8890-edd403bce7d0,mac_address=fa:16:3e:29:5f:f3,name='',network_id=93fca803-def7-462d-b519-0eb07f4ac511,numa_affinity_policy=,project_id='027792a6118140099aaf522ca15bb07e',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(7f2856e4-8bb1-4647-8890-edd403bce7d0),security_group_ids=set([]),status='DOWN',updated_at=2022-09-04T01:14:13Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:14.132766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-1dfe509f-fc6a-4c60-ba02-b59ea15e9cd0 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (7f2856e4-8bb1-4647-8890-edd403bce7d0), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:14.351066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-2fc0d98e-8af6-43b0-9b92-2dda51b136fd None None] Resource Port e7120691-3bea-4fb5-9cd0-62e18c24380d updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=e7120691-3bea-4fb5-9cd0-62e18c24380d,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=e7120691-3bea-4fb5-9cd0-62e18c24380d,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:14:14.351706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-2fc0d98e-8af6-43b0-9b92-2dda51b136fd None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (e7120691-3bea-4fb5-9cd0-62e18c24380d), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:14.457521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["98b725d3-6ceb-470f-b2fb-dc9ff0f3878e","delete","qr-f0af75e4-63",26,["map",[["attached-mac","fa:16:3e:d7:5f:dc"],["iface-id","f0af75e4-63aa-44d3-bff7-973c3caf9bf9"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:14:14.516413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-5f716760-2f31-47ec-94f0-a792351c975f admin admin] Resource Port deleted: da545e71-9e15-495e-b08a-2c36ede84742 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:14.517384 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-5f716760-2f31-47ec-94f0-a792351c975f admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (da545e71-9e15-495e-b08a-2c36ede84742), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:14.533364 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:522 started Sep 04 01:14:14.670613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-2fc0d98e-8af6-43b0-9b92-2dda51b136fd None None] Resource Port e7120691-3bea-4fb5-9cd0-62e18c24380d updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=e7120691-3bea-4fb5-9cd0-62e18c24380d,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=e7120691-3bea-4fb5-9cd0-62e18c24380d,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=e7120691-3bea-4fb5-9cd0-62e18c24380d,segment=NetworkSegment(c26850af-ca47-4ea8-9a33-a34f3381800e),segment_id=c26850af-ca47-4ea8-9a33-a34f3381800e)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:14:14.673380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-2fc0d98e-8af6-43b0-9b92-2dda51b136fd None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (e7120691-3bea-4fb5-9cd0-62e18c24380d), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:14.769965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5777,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=143000000,duration_sec=1064,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:14.776451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-1dfe509f-fc6a-4c60-ba02-b59ea15e9cd0 admin admin] Received resource Port update without any changes: 7f2856e4-8bb1-4647-8890-edd403bce7d0 {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:181}} Sep 04 01:14:14.778713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:14:14.779992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:522 - starting polling. Elapsed:0.247 Sep 04 01:14:14.781908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:14.787622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-da545e71-9e, col_values=(('tag', 4095),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:14.807379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade5779,OFPFlowMod(buffer_id=4294967295,command=0,cookie=6887031442322345889,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 25}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:14.808010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for ['da545e71-9e15-495e-b08a-2c36ede84742'] Sep 04 01:14:14.808603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 4 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:14:14.887290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[249f55c0-e82f-4581-aa81-d5be1384edf3]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:14:14.892002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade577b,OFPFlowMod(buffer_id=4294967295,command=3,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 26}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:14.892605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:522 - port information retrieved. Elapsed:0.359 Sep 04 01:14:14.893132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Starting to process devices in:{'current': {'3fa24970-97a7-4f46-ac55-0b24323fa402', '5f5b2b5c-f8bd-4ca8-94f2-f4d5e3a6444d', '89aa06b4-bbf1-40c2-bb48-500c3aecdf48', 'b4f93563-ff7a-44c4-96a1-87f6e4348648', '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', 'da545e71-9e15-495e-b08a-2c36ede84742', 'ca102ce7-433c-4029-aabf-33d944165ff1'}, 'added': set(), 'removed': {'f0af75e4-63aa-44d3-bff7-973c3caf9bf9'}, 'updated': {'5f5b2b5c-f8bd-4ca8-94f2-f4d5e3a6444d'}, 're_added': set()} {{(pid=107812) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 04 01:14:14.893886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': '5f5b2b5c-f8bd-4ca8-94f2-f4d5e3a6444d', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-93fca803-def7-462d-b519-0eb07f4ac511', 'network_id': '93fca803-def7-462d-b519-0eb07f4ac511', 'port_id': '5f5b2b5c-f8bd-4ca8-94f2-f4d5e3a6444d', 'mac_address': 'fa:16:3e:e3:22:a0', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 189, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '231765c8-800c-4149-b414-9dbe7bc03304', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 01:14:14.897259 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: 5f5b2b5c-f8bd-4ca8-94f2-f4d5e3a6444d {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:14:14.898235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 5f5b2b5c-f8bd-4ca8-94f2-f4d5e3a6444d updated. Details: {'device': '5f5b2b5c-f8bd-4ca8-94f2-f4d5e3a6444d', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-93fca803-def7-462d-b519-0eb07f4ac511', 'network_id': '93fca803-def7-462d-b519-0eb07f4ac511', 'port_id': '5f5b2b5c-f8bd-4ca8-94f2-f4d5e3a6444d', 'mac_address': 'fa:16:3e:e3:22:a0', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 189, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '231765c8-800c-4149-b414-9dbe7bc03304', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 11} Sep 04 01:14:14.899565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap5f5b2b5c-f8, col_values=(('tag', 11),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:14.900229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap5f5b2b5c-f8, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:14.900764 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap5f5b2b5c-f8, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:14.901411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 01:14:14.902894 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap5f5b2b5c-f8, col_values=(('other_config', {'net_uuid': '93fca803-def7-462d-b519-0eb07f4ac511', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '189', 'tag': '11'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:14.904644 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 01:14:14.909583 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade577d,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 27}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:14.910186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:522 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 7 devices currently available. Time elapsed: 0.016 Sep 04 01:14:14.923480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Refreshing firewall for 1 devices {{(pid=107812) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 04 01:14:14.924114 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Refresh firewall rules Sep 04 01:14:14.925597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information for ports dict_keys([]) {{(pid=107812) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 04 01:14:14.928795 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information {{(pid=107812) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 04 01:14:14.946972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 2 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:14:14.948728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["f05d6238-ab29-48ce-877e-81d21268f45a","delete","qg-da545e71-9e",25,["map",[["attached-mac","fa:16:3e:ac:31:a7"],["iface-id","da545e71-9e15-495e-b08a-2c36ede84742"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:14:15.270916 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[380e781f-8460-4ecf-af07-6fbd549400a1]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:14:15.272347 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:522 - agent port security group processed in 0.379 Sep 04 01:14:15.273202 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for 5f5b2b5c-f8bd-4ca8-94f2-f4d5e3a6444d to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 01:14:15.295633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["2f7b6bf9-84bb-4239-b6e7-cad03019618b","insert","qr-7f2856e4-8b",["set",[]],["map",[["attached-mac","fa:16:3e:29:5f:f3"],["iface-id","7f2856e4-8bb1-4647-8890-edd403bce7d0"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:14:15.327146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["2f7b6bf9-84bb-4239-b6e7-cad03019618b","old",null,["set",[]],null],["","new","qr-7f2856e4-8b",28,["map",[["attached-mac","fa:16:3e:29:5f:f3"],["iface-id","7f2856e4-8bb1-4647-8890-edd403bce7d0"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:14:15.387376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-838a2bbf-70f1-460c-807f-14093b88a8cc admin admin] Resource Subnet deleted: 14d0e241-d5e5-432d-8a38-2add02637159 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:15.388779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-838a2bbf-70f1-460c-807f-14093b88a8cc admin admin] Publish callbacks [] for Subnet (14d0e241-d5e5-432d-8a38-2add02637159), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:15.683900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["5bd68b58-c430-495c-8d1b-e967647c1ea4","delete","tapb4f93563-ff",24,["map",[["attached-mac","fa:16:3e:c7:37:e2"],["iface-id","b4f93563-ff7a-44c4-96a1-87f6e4348648"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:14:15.693761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Configuration for devices up ['5f5b2b5c-f8bd-4ca8-94f2-f4d5e3a6444d'] and devices down [] completed. Sep 04 01:14:15.694355 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for {'f0af75e4-63aa-44d3-bff7-973c3caf9bf9'} Sep 04 01:14:15.694834 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 4 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:14:15.769476 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1eea83-407e-4918-9bbc-866ded6ca969]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:14:15.770236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Ports {'f0af75e4-63aa-44d3-bff7-973c3caf9bf9'} removed Sep 04 01:14:15.907930 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port removal failed for set() {{(pid=107812) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 04 01:14:15.908345 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:522 - treat_devices_removed completed in 0.214 Sep 04 01:14:15.908642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:522 - ports processed. Elapsed:1.375 Sep 04 01:14:15.909000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:522 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 1}}. Elapsed:1.376 Sep 04 01:14:16.049494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-46c44faa-7378-4d10-8bb6-3f50ae356bc4 admin admin] Resource Port deleted: b4f93563-ff7a-44c4-96a1-87f6e4348648 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:16.051172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-46c44faa-7378-4d10-8bb6-3f50ae356bc4 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (b4f93563-ff7a-44c4-96a1-87f6e4348648), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:16.103527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["5a58ad02-b9fc-435a-9759-c6e11e6e11cd","insert","qg-e7120691-3b",["set",[]],["map",[["attached-mac","fa:16:3e:f7:3f:6e"],["iface-id","e7120691-3bea-4fb5-9cd0-62e18c24380d"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:14:16.105056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-6e7e5dc1-2d95-4267-ba1f-f760b3164b6e None None] Resource Port deleted: b4f93563-ff7a-44c4-96a1-87f6e4348648 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:16.105637 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-6e7e5dc1-2d95-4267-ba1f-f760b3164b6e None None] Skipped duplicate delete event for b4f93563-ff7a-44c4-96a1-87f6e4348648 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:209}} Sep 04 01:14:16.147469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["5a58ad02-b9fc-435a-9759-c6e11e6e11cd","old",null,["set",[]],null],["","new","qg-e7120691-3b",29,["map",[["attached-mac","fa:16:3e:f7:3f:6e"],["iface-id","e7120691-3bea-4fb5-9cd0-62e18c24380d"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:14:16.479758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-46c44faa-7378-4d10-8bb6-3f50ae356bc4 admin admin] Resource Network deleted: 235816d2-dc0c-4d16-940b-c00d2dfa0d18 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:16.480346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-46c44faa-7378-4d10-8bb6-3f50ae356bc4 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533'] for Network (235816d2-dc0c-4d16-940b-c00d2dfa0d18), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:16.534203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:523 started Sep 04 01:14:16.537933 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade577f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=928000000,duration_sec=1065,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:16.538726 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:14:16.539444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:523 - starting polling. Elapsed:0.005 Sep 04 01:14:16.541578 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:16.551248 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade5781,OFPFlowMod(buffer_id=4294967295,command=3,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 24}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:16.552451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade5783,OFPFlowMod(buffer_id=4294967295,command=3,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 25}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:16.553053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:523 - port information retrieved. Elapsed:0.019 Sep 04 01:14:16.553540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Starting to process devices in:{'current': {'3fa24970-97a7-4f46-ac55-0b24323fa402', '5f5b2b5c-f8bd-4ca8-94f2-f4d5e3a6444d', '89aa06b4-bbf1-40c2-bb48-500c3aecdf48', 'e7120691-3bea-4fb5-9cd0-62e18c24380d', '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', '7f2856e4-8bb1-4647-8890-edd403bce7d0', 'ca102ce7-433c-4029-aabf-33d944165ff1'}, 'added': {'e7120691-3bea-4fb5-9cd0-62e18c24380d', '7f2856e4-8bb1-4647-8890-edd403bce7d0'}, 'removed': {'da545e71-9e15-495e-b08a-2c36ede84742', 'b4f93563-ff7a-44c4-96a1-87f6e4348648'}, 'updated': set(), 're_added': set()} {{(pid=107812) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 04 01:14:16.554458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': 'e7120691-3bea-4fb5-9cd0-62e18c24380d', 'device_id': '54174312-f04b-4db8-8dc3-1c58848b0d5e', 'network_id': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'port_id': 'e7120691-3bea-4fb5-9cd0-62e18c24380d', 'mac_address': 'fa:16:3e:f7:3f:6e', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '2b17f894-c374-4207-90ad-14f794c86627', 'ip_address': '172.37.7.228'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 01:14:16.555343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: WARNING neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Device Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:14:13Z,data_plane_status=None,description='',device_id='54174312-f04b-4db8-8dc3-1c58848b0d5e',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=7f2856e4-8bb1-4647-8890-edd403bce7d0,mac_address=fa:16:3e:29:5f:f3,name='',network_id=93fca803-def7-462d-b519-0eb07f4ac511,numa_affinity_policy=,project_id='027792a6118140099aaf522ca15bb07e',qos_network_policy_id=None,qos_policy_id=None,revision_number=2,security=PortSecurity(7f2856e4-8bb1-4647-8890-edd403bce7d0),security_group_ids=set([]),status='DOWN',updated_at=2022-09-04T01:14:14Z) is not bound. Sep 04 01:14:16.557712 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: e7120691-3bea-4fb5-9cd0-62e18c24380d {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:14:16.558162 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port e7120691-3bea-4fb5-9cd0-62e18c24380d updated. Details: {'device': 'e7120691-3bea-4fb5-9cd0-62e18c24380d', 'device_id': '54174312-f04b-4db8-8dc3-1c58848b0d5e', 'network_id': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'port_id': 'e7120691-3bea-4fb5-9cd0-62e18c24380d', 'mac_address': 'fa:16:3e:f7:3f:6e', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '2b17f894-c374-4207-90ad-14f794c86627', 'ip_address': '172.37.7.228'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 04 01:14:16.559249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-e7120691-3b, col_values=(('tag', 2),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:16.559800 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-e7120691-3b, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:16.561046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-e7120691-3b, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:16.569105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-e7120691-3b, col_values=(('other_config', {'net_uuid': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:16.581455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade5785,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 29}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:16.581869 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: 7f2856e4-8bb1-4647-8890-edd403bce7d0 {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:14:16.582236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: WARNING neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Device 7f2856e4-8bb1-4647-8890-edd403bce7d0 not defined on plugin or binding failed Sep 04 01:14:16.582819 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:523 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 7 devices currently available. Time elapsed: 0.029 Sep 04 01:14:16.583445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Preparing device filters for 2 new devices {{(pid=107812) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 04 01:14:16.583816 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Preparing filters for devices {'e7120691-3bea-4fb5-9cd0-62e18c24380d', '7f2856e4-8bb1-4647-8890-edd403bce7d0'} Sep 04 01:14:16.586276 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information for ports dict_keys([]) {{(pid=107812) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 04 01:14:16.587921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information {{(pid=107812) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 04 01:14:16.589888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 2 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:14:16.657458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9ac3f3-efa8-4a29-9719-77b3f7081e7e]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:14:16.658192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:523 - agent port security group processed in 0.104 Sep 04 01:14:16.659342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for e7120691-3bea-4fb5-9cd0-62e18c24380d to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 01:14:16.977560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-dbd35245-3966-40cf-b178-6260ebdf4602 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:14:16Z,description='Default security group',id=fcffb30e-54bc-46bc-bcad-d2bb85743e24,is_default=True,name='default',project_id='abca446946bf4b32a50b47d29e71cba0',revision_number=1,rules=[SecurityGroupRule(14da2436-6c31-4861-9912-8996a23db711),SecurityGroupRule(5379d381-bacb-44bd-8c82-54e5ec1264ea),SecurityGroupRule(7ea86ecb-6921-4368-95f1-d65be594baa7),SecurityGroupRule(8ad84c51-4f85-4266-89c5-c54e0d938467)],shared=False,stateful=True,updated_at=2022-09-04T01:14:16Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:16.977934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-dbd35245-3966-40cf-b178-6260ebdf4602 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (fcffb30e-54bc-46bc-bcad-d2bb85743e24), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:16.978907 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-dbd35245-3966-40cf-b178-6260ebdf4602 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:14:16Z,description=,direction='egress',ethertype='IPv4',id=14da2436-6c31-4861-9912-8996a23db711,normalized_cidr=None,port_range_max=,port_range_min=,project_id='abca446946bf4b32a50b47d29e71cba0',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=fcffb30e-54bc-46bc-bcad-d2bb85743e24,updated_at=2022-09-04T01:14:16Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:16.979268 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-dbd35245-3966-40cf-b178-6260ebdf4602 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (14da2436-6c31-4861-9912-8996a23db711), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:16.979631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-dbd35245-3966-40cf-b178-6260ebdf4602 admin admin] Security group rule updated ['fcffb30e-54bc-46bc-bcad-d2bb85743e24'] Sep 04 01:14:16.980352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-dbd35245-3966-40cf-b178-6260ebdf4602 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:14:16Z,description=,direction='ingress',ethertype='IPv4',id=5379d381-bacb-44bd-8c82-54e5ec1264ea,normalized_cidr=None,port_range_max=,port_range_min=,project_id='abca446946bf4b32a50b47d29e71cba0',protocol=,remote_address_group_id=,remote_group_id=fcffb30e-54bc-46bc-bcad-d2bb85743e24,remote_ip_prefix=,revision_number=0,security_group_id=fcffb30e-54bc-46bc-bcad-d2bb85743e24,updated_at=2022-09-04T01:14:16Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:16.980938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-dbd35245-3966-40cf-b178-6260ebdf4602 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (5379d381-bacb-44bd-8c82-54e5ec1264ea), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:16.981569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-dbd35245-3966-40cf-b178-6260ebdf4602 admin admin] Security group rule updated ['fcffb30e-54bc-46bc-bcad-d2bb85743e24'] Sep 04 01:14:16.983004 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-dbd35245-3966-40cf-b178-6260ebdf4602 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:14:16Z,description=,direction='ingress',ethertype='IPv6',id=7ea86ecb-6921-4368-95f1-d65be594baa7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='abca446946bf4b32a50b47d29e71cba0',protocol=,remote_address_group_id=,remote_group_id=fcffb30e-54bc-46bc-bcad-d2bb85743e24,remote_ip_prefix=,revision_number=0,security_group_id=fcffb30e-54bc-46bc-bcad-d2bb85743e24,updated_at=2022-09-04T01:14:16Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:16.984448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-dbd35245-3966-40cf-b178-6260ebdf4602 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (7ea86ecb-6921-4368-95f1-d65be594baa7), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:16.991678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-dbd35245-3966-40cf-b178-6260ebdf4602 admin admin] Security group rule updated ['fcffb30e-54bc-46bc-bcad-d2bb85743e24'] Sep 04 01:14:16.994668 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-dbd35245-3966-40cf-b178-6260ebdf4602 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:14:16Z,description=,direction='egress',ethertype='IPv6',id=8ad84c51-4f85-4266-89c5-c54e0d938467,normalized_cidr=None,port_range_max=,port_range_min=,project_id='abca446946bf4b32a50b47d29e71cba0',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=fcffb30e-54bc-46bc-bcad-d2bb85743e24,updated_at=2022-09-04T01:14:16Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:16.997303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-dbd35245-3966-40cf-b178-6260ebdf4602 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (8ad84c51-4f85-4266-89c5-c54e0d938467), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:16.998922 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-dbd35245-3966-40cf-b178-6260ebdf4602 admin admin] Security group rule updated ['fcffb30e-54bc-46bc-bcad-d2bb85743e24'] Sep 04 01:14:17.018184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Configuration for devices up ['e7120691-3bea-4fb5-9cd0-62e18c24380d'] and devices down [] completed. Sep 04 01:14:17.018549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for {'da545e71-9e15-495e-b08a-2c36ede84742', 'b4f93563-ff7a-44c4-96a1-87f6e4348648'} Sep 04 01:14:17.018879 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port da545e71-9e15-495e-b08a-2c36ede84742 is not handled by the firewall. {{(pid=107812) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 04 01:14:17.026518 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 4 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:14:17.095291 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Resource Port e7120691-3bea-4fb5-9cd0-62e18c24380d updated (revision_number 3->4). Old fields: {'status': 'DOWN', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=e7120691-3bea-4fb5-9cd0-62e18c24380d,segment=NetworkSegment(c26850af-ca47-4ea8-9a33-a34f3381800e),segment_id=c26850af-ca47-4ea8-9a33-a34f3381800e)]} New fields: {'status': 'ACTIVE', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=e7120691-3bea-4fb5-9cd0-62e18c24380d,segment=NetworkSegment(c26850af-ca47-4ea8-9a33-a34f3381800e),segment_id=c26850af-ca47-4ea8-9a33-a34f3381800e)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:14:17.096770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (e7120691-3bea-4fb5-9cd0-62e18c24380d), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:17.097952 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[460e920e-8923-4af7-ae69-86d96159b2b0]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:14:17.098653 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Ports {'da545e71-9e15-495e-b08a-2c36ede84742', 'b4f93563-ff7a-44c4-96a1-87f6e4348648'} removed Sep 04 01:14:17.157320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port removal failed for set() {{(pid=107812) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 04 01:14:17.157686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] net_uuid None not managed by VLAN manager Sep 04 01:14:17.158065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Reclaiming vlan = 10 from net-id = 235816d2-dc0c-4d16-940b-c00d2dfa0d18, seg-id = 155 Sep 04 01:14:17.160732 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x1fd38c0f,OFPFlowMod(buffer_id=4294967295,command=3,cookie=6561907047025962751,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4106}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:17.163627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xeade5787,OFPFlowMod(buffer_id=4294967295,command=3,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4251}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:17.163960 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:523 - treat_devices_removed completed in 0.145 Sep 04 01:14:17.164263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:523 - ports processed. Elapsed:0.630 Sep 04 01:14:17.164593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:523 completed. Processed ports statistics: {'regular': {'added': 2, 'updated': 0, 'removed': 2}}. Elapsed:0.631 Sep 04 01:14:17.203338 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-dbd35245-3966-40cf-b178-6260ebdf4602 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-04T01:14:16Z,description='',dns_domain=None,id=dd0b2869-d6c7-4142-bc77-f5ba8b31cfeb,mtu=1500,name='tempest-TestMinimumBasicScenario-1757848580-network',project_id='abca446946bf4b32a50b47d29e71cba0',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(dd0b2869-d6c7-4142-bc77-f5ba8b31cfeb),segments=[NetworkSegment(1937bb3a-afad-401d-a1b2-924e74017550)],shared=False,status='ACTIVE',updated_at=2022-09-04T01:14:16Z,vlan_transparent=) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:17.203722 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-dbd35245-3966-40cf-b178-6260ebdf4602 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533'] for Network (dd0b2869-d6c7-4142-bc77-f5ba8b31cfeb), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:17.289262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager [None req-dbd35245-3966-40cf-b178-6260ebdf4602 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network dd0b2869-d6c7-4142-bc77-f5ba8b31cfeb with segmentation id not found. Sep 04 01:14:17.289262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 04 01:14:17.289262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 04 01:14:17.289262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 04 01:14:17.289262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 04 01:14:17.289262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 04 01:14:17.289262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 04 01:14:17.289262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 04 01:14:17.289262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 04 01:14:17.289262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 04 01:14:17.289262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 04 01:14:17.289262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 04 01:14:17.289262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 04 01:14:17.290423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 04 01:14:17.290423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 04 01:14:17.290423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 04 01:14:17.290423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network dd0b2869-d6c7-4142-bc77-f5ba8b31cfeb with segmentation id not found. Sep 04 01:14:17.290423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager Sep 04 01:14:17.401953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-68331ab7-8149-4fee-a334-75b6e6912486 admin admin] Resource SecurityGroup deleted: a8764ee1-c7fb-4fc4-9d1d-0fd46b8560a9 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:17.402329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-68331ab7-8149-4fee-a334-75b6e6912486 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (a8764ee1-c7fb-4fc4-9d1d-0fd46b8560a9), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:17.402789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68331ab7-8149-4fee-a334-75b6e6912486 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('a8764ee1-c7fb-4fc4-9d1d-0fd46b8560a9',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:14:17.417753 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-68331ab7-8149-4fee-a334-75b6e6912486 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('a8764ee1-c7fb-4fc4-9d1d-0fd46b8560a9',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:14:17.418239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-68331ab7-8149-4fee-a334-75b6e6912486 admin admin] Resource SecurityGroupRule deleted: 11828f56-dd52-4a3b-94da-a0bef8472d57 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:17.418601 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-68331ab7-8149-4fee-a334-75b6e6912486 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (11828f56-dd52-4a3b-94da-a0bef8472d57), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:17.418943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-68331ab7-8149-4fee-a334-75b6e6912486 admin admin] Security group rule updated ['a8764ee1-c7fb-4fc4-9d1d-0fd46b8560a9'] Sep 04 01:14:17.419975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-68331ab7-8149-4fee-a334-75b6e6912486 admin admin] Resource SecurityGroupRule deleted: 795d89de-1dd7-4055-9f1b-0e71966260be {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:17.420327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-68331ab7-8149-4fee-a334-75b6e6912486 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (795d89de-1dd7-4055-9f1b-0e71966260be), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:17.420651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-68331ab7-8149-4fee-a334-75b6e6912486 admin admin] Security group rule updated ['a8764ee1-c7fb-4fc4-9d1d-0fd46b8560a9'] Sep 04 01:14:17.421094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-68331ab7-8149-4fee-a334-75b6e6912486 admin admin] Resource SecurityGroupRule deleted: e5f5c91f-5e9f-4fb4-99ed-f28b1eaa1e1f {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:17.421447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-68331ab7-8149-4fee-a334-75b6e6912486 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (e5f5c91f-5e9f-4fb4-99ed-f28b1eaa1e1f), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:17.421767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-68331ab7-8149-4fee-a334-75b6e6912486 admin admin] Security group rule updated ['a8764ee1-c7fb-4fc4-9d1d-0fd46b8560a9'] Sep 04 01:14:17.422183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-68331ab7-8149-4fee-a334-75b6e6912486 admin admin] Resource SecurityGroupRule deleted: f7e999f1-25f7-494d-addb-bc36db1e03a3 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:17.422527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-68331ab7-8149-4fee-a334-75b6e6912486 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (f7e999f1-25f7-494d-addb-bc36db1e03a3), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:17.422847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-68331ab7-8149-4fee-a334-75b6e6912486 admin admin] Security group rule updated ['a8764ee1-c7fb-4fc4-9d1d-0fd46b8560a9'] Sep 04 01:14:17.667025 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-93311402-6d93-467a-b453-4d62c6b27dae admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(e19a160b-14a4-43fa-be49-a1ecb71fd588)],cidr=172.20.0.0/28,created_at=2022-09-04T01:14:17Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=41b00470-0fa1-4d8a-8c47-37a6136cdce6,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-TestMinimumBasicScenario-1757848580-subnet',network_id=dd0b2869-d6c7-4142-bc77-f5ba8b31cfeb,project_id='abca446946bf4b32a50b47d29e71cba0',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-04T01:14:17Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:17.667681 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-93311402-6d93-467a-b453-4d62c6b27dae admin admin] Publish callbacks [] for Subnet (41b00470-0fa1-4d8a-8c47-37a6136cdce6), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:18.527908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-5bec6300-bd74-464c-aa1c-98254388c439 admin admin] Resource SecurityGroup deleted: 1bb45a56-42b8-452e-b03e-b012f54274c3 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:18.528987 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-5bec6300-bd74-464c-aa1c-98254388c439 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (1bb45a56-42b8-452e-b03e-b012f54274c3), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:18.529862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bec6300-bd74-464c-aa1c-98254388c439 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('1bb45a56-42b8-452e-b03e-b012f54274c3',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:14:18.535278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:524 started Sep 04 01:14:18.538508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5789,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=930000000,duration_sec=1067,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:18.539190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:14:18.539717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:524 - starting polling. Elapsed:0.004 Sep 04 01:14:18.541305 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:18.543983 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:524 - port information retrieved. Elapsed:0.008 Sep 04 01:14:18.545094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Starting to process devices in:{'current': {'3fa24970-97a7-4f46-ac55-0b24323fa402', '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', '5f5b2b5c-f8bd-4ca8-94f2-f4d5e3a6444d', '89aa06b4-bbf1-40c2-bb48-500c3aecdf48', 'e7120691-3bea-4fb5-9cd0-62e18c24380d', '7f2856e4-8bb1-4647-8890-edd403bce7d0', 'ca102ce7-433c-4029-aabf-33d944165ff1'}, 'added': set(), 'removed': set(), 'updated': {'e7120691-3bea-4fb5-9cd0-62e18c24380d'}, 're_added': set()} {{(pid=107812) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 04 01:14:18.545779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': 'e7120691-3bea-4fb5-9cd0-62e18c24380d', 'device_id': '54174312-f04b-4db8-8dc3-1c58848b0d5e', 'network_id': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'port_id': 'e7120691-3bea-4fb5-9cd0-62e18c24380d', 'mac_address': 'fa:16:3e:f7:3f:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '2b17f894-c374-4207-90ad-14f794c86627', 'ip_address': '172.37.7.228'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 01:14:18.547782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: e7120691-3bea-4fb5-9cd0-62e18c24380d {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:14:18.556079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port e7120691-3bea-4fb5-9cd0-62e18c24380d updated. Details: {'device': 'e7120691-3bea-4fb5-9cd0-62e18c24380d', 'device_id': '54174312-f04b-4db8-8dc3-1c58848b0d5e', 'network_id': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'port_id': 'e7120691-3bea-4fb5-9cd0-62e18c24380d', 'mac_address': 'fa:16:3e:f7:3f:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '2b17f894-c374-4207-90ad-14f794c86627', 'ip_address': '172.37.7.228'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 04 01:14:18.556079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-e7120691-3b, col_values=(('tag', 2),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:18.556079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-e7120691-3b, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:18.556079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-e7120691-3b, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:18.556551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 01:14:18.556551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-e7120691-3b, col_values=(('other_config', {'net_uuid': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:18.556551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 01:14:18.556551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade578b,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 29}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:18.556551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:524 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 7 devices currently available. Time elapsed: 0.011 Sep 04 01:14:18.556911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Refreshing firewall for 1 devices {{(pid=107812) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 04 01:14:18.556911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Refresh firewall rules Sep 04 01:14:18.558052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information for ports dict_keys([]) {{(pid=107812) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 04 01:14:18.558515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information {{(pid=107812) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 04 01:14:18.563585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 2 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:14:18.565755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-5bec6300-bd74-464c-aa1c-98254388c439 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('1bb45a56-42b8-452e-b03e-b012f54274c3',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:14:18.566182 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-5bec6300-bd74-464c-aa1c-98254388c439 admin admin] Resource SecurityGroupRule deleted: 3f880900-2dd3-4b36-b710-ac6ef186c6fe {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:18.566548 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-5bec6300-bd74-464c-aa1c-98254388c439 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (3f880900-2dd3-4b36-b710-ac6ef186c6fe), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:18.567045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-5bec6300-bd74-464c-aa1c-98254388c439 admin admin] Security group rule updated ['1bb45a56-42b8-452e-b03e-b012f54274c3'] Sep 04 01:14:18.638227 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e2c1b1c-3bbe-49f4-b98d-8c9324382743]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:14:18.640342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:524 - agent port security group processed in 0.095 Sep 04 01:14:18.641919 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for e7120691-3bea-4fb5-9cd0-62e18c24380d to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 01:14:18.643841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-5bec6300-bd74-464c-aa1c-98254388c439 admin admin] Resource SecurityGroupRule deleted: 645fe458-fbd4-42b9-9fb3-6ec1d6f1c8a8 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:18.644412 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-5bec6300-bd74-464c-aa1c-98254388c439 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (645fe458-fbd4-42b9-9fb3-6ec1d6f1c8a8), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:18.644964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-5bec6300-bd74-464c-aa1c-98254388c439 admin admin] Security group rule updated ['1bb45a56-42b8-452e-b03e-b012f54274c3'] Sep 04 01:14:18.645562 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-5bec6300-bd74-464c-aa1c-98254388c439 admin admin] Resource SecurityGroupRule deleted: 66a40f26-e1ad-4521-8412-944322f10ec7 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:18.646082 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-5bec6300-bd74-464c-aa1c-98254388c439 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (66a40f26-e1ad-4521-8412-944322f10ec7), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:18.646570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-5bec6300-bd74-464c-aa1c-98254388c439 admin admin] Security group rule updated ['1bb45a56-42b8-452e-b03e-b012f54274c3'] Sep 04 01:14:18.647169 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-5bec6300-bd74-464c-aa1c-98254388c439 admin admin] Resource SecurityGroupRule deleted: 7a58ce1a-6cf9-4a51-8958-166e23739987 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:18.648528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-5bec6300-bd74-464c-aa1c-98254388c439 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (7a58ce1a-6cf9-4a51-8958-166e23739987), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:18.649319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-5bec6300-bd74-464c-aa1c-98254388c439 admin admin] Security group rule updated ['1bb45a56-42b8-452e-b03e-b012f54274c3'] Sep 04 01:14:19.281998 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-26f7d219-fef6-4f18-b241-62857767c496 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:14:18Z,data_plane_status=None,description='',device_id='5588f3e0-bce0-42ce-b4bf-d971c8482e9b',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=82064230-2100-4279-b030-003ad6dab6f1,mac_address=fa:16:3e:a0:05:ba,name='',network_id=e8e0564a-d5c9-4fe0-b2d4-538f45096708,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(82064230-2100-4279-b030-003ad6dab6f1),security_group_ids=set([]),status='DOWN',updated_at=2022-09-04T01:14:18Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:19.282604 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-26f7d219-fef6-4f18-b241-62857767c496 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (82064230-2100-4279-b030-003ad6dab6f1), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:19.284766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Configuration for devices up ['e7120691-3bea-4fb5-9cd0-62e18c24380d'] and devices down [] completed. Sep 04 01:14:19.289384 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:524 - ports processed. Elapsed:0.750 Sep 04 01:14:19.289384 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:524 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.750 Sep 04 01:14:19.426732 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-d02c3e46-3e21-41ea-9f5a-003a98eafd1c None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:14:18Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-dd0b2869-d6c7-4142-bc77-f5ba8b31cfeb',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=cd34646e-9957-4ab9-b15e-f0afcfd59c3b,mac_address=fa:16:3e:1d:7d:67,name='',network_id=dd0b2869-d6c7-4142-bc77-f5ba8b31cfeb,numa_affinity_policy=,project_id='abca446946bf4b32a50b47d29e71cba0',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(cd34646e-9957-4ab9-b15e-f0afcfd59c3b),security_group_ids=set([]),status='DOWN',updated_at=2022-09-04T01:14:19Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:19.427446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-d02c3e46-3e21-41ea-9f5a-003a98eafd1c None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (cd34646e-9957-4ab9-b15e-f0afcfd59c3b), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:19.542140 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-991ffc11-109c-496e-8fc8-a79f2be6ec11 None None] Resource Port 7f2856e4-8bb1-4647-8890-edd403bce7d0 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=7f2856e4-8bb1-4647-8890-edd403bce7d0,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=7f2856e4-8bb1-4647-8890-edd403bce7d0,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:14:19.542140 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-991ffc11-109c-496e-8fc8-a79f2be6ec11 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (7f2856e4-8bb1-4647-8890-edd403bce7d0), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:19.850432 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-d02c3e46-3e21-41ea-9f5a-003a98eafd1c None None] Resource Port cd34646e-9957-4ab9-b15e-f0afcfd59c3b updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=cd34646e-9957-4ab9-b15e-f0afcfd59c3b,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=cd34646e-9957-4ab9-b15e-f0afcfd59c3b,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=cd34646e-9957-4ab9-b15e-f0afcfd59c3b,segment=NetworkSegment(1937bb3a-afad-401d-a1b2-924e74017550),segment_id=1937bb3a-afad-401d-a1b2-924e74017550)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:14:19.850827 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-d02c3e46-3e21-41ea-9f5a-003a98eafd1c None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (cd34646e-9957-4ab9-b15e-f0afcfd59c3b), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:19.982446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["3e75b8c9-7a48-4459-9681-052a27aeef9e","insert","tapcd34646e-99",["set",[]],["map",[["attached-mac","fa:16:3e:1d:7d:67"],["iface-id","cd34646e-9957-4ab9-b15e-f0afcfd59c3b"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:14:19.994566 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-991ffc11-109c-496e-8fc8-a79f2be6ec11 None None] Resource Port 7f2856e4-8bb1-4647-8890-edd403bce7d0 updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=7f2856e4-8bb1-4647-8890-edd403bce7d0,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=7f2856e4-8bb1-4647-8890-edd403bce7d0,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=7f2856e4-8bb1-4647-8890-edd403bce7d0,segment=NetworkSegment(bb3f529c-5ae7-4cc5-a11f-2074c23f8407),segment_id=bb3f529c-5ae7-4cc5-a11f-2074c23f8407)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:14:19.995487 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-991ffc11-109c-496e-8fc8-a79f2be6ec11 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (7f2856e4-8bb1-4647-8890-edd403bce7d0), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:20.001871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["3e75b8c9-7a48-4459-9681-052a27aeef9e","old",null,["set",[]],null],["","new","tapcd34646e-99",30,["map",[["attached-mac","fa:16:3e:1d:7d:67"],["iface-id","cd34646e-9957-4ab9-b15e-f0afcfd59c3b"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:14:20.536599 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:525 started Sep 04 01:14:20.539267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade578d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=931000000,duration_sec=1069,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:20.540026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:14:20.540594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:525 - starting polling. Elapsed:0.004 Sep 04 01:14:20.542389 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:20.548565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:525 - port information retrieved. Elapsed:0.009 Sep 04 01:14:20.549285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Starting to process devices in:{'current': {'3fa24970-97a7-4f46-ac55-0b24323fa402', '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', '5f5b2b5c-f8bd-4ca8-94f2-f4d5e3a6444d', 'cd34646e-9957-4ab9-b15e-f0afcfd59c3b', '89aa06b4-bbf1-40c2-bb48-500c3aecdf48', 'e7120691-3bea-4fb5-9cd0-62e18c24380d', '7f2856e4-8bb1-4647-8890-edd403bce7d0', 'ca102ce7-433c-4029-aabf-33d944165ff1'}, 'added': {'cd34646e-9957-4ab9-b15e-f0afcfd59c3b'}, 'removed': set(), 'updated': {'7f2856e4-8bb1-4647-8890-edd403bce7d0', 'cd34646e-9957-4ab9-b15e-f0afcfd59c3b'}, 're_added': set()} {{(pid=107812) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 04 01:14:20.553805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': '7f2856e4-8bb1-4647-8890-edd403bce7d0', 'device_id': '54174312-f04b-4db8-8dc3-1c58848b0d5e', 'network_id': '93fca803-def7-462d-b519-0eb07f4ac511', 'port_id': '7f2856e4-8bb1-4647-8890-edd403bce7d0', 'mac_address': 'fa:16:3e:29:5f:f3', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 189, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '231765c8-800c-4149-b414-9dbe7bc03304', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 01:14:20.556039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': 'cd34646e-9957-4ab9-b15e-f0afcfd59c3b', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-dd0b2869-d6c7-4142-bc77-f5ba8b31cfeb', 'network_id': 'dd0b2869-d6c7-4142-bc77-f5ba8b31cfeb', 'port_id': 'cd34646e-9957-4ab9-b15e-f0afcfd59c3b', 'mac_address': 'fa:16:3e:1d:7d:67', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 190, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '41b00470-0fa1-4d8a-8c47-37a6136cdce6', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 01:14:20.561772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: 7f2856e4-8bb1-4647-8890-edd403bce7d0 {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:14:20.563189 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 7f2856e4-8bb1-4647-8890-edd403bce7d0 updated. Details: {'device': '7f2856e4-8bb1-4647-8890-edd403bce7d0', 'device_id': '54174312-f04b-4db8-8dc3-1c58848b0d5e', 'network_id': '93fca803-def7-462d-b519-0eb07f4ac511', 'port_id': '7f2856e4-8bb1-4647-8890-edd403bce7d0', 'mac_address': 'fa:16:3e:29:5f:f3', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 189, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '231765c8-800c-4149-b414-9dbe7bc03304', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 11} Sep 04 01:14:20.566586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-7f2856e4-8b, col_values=(('tag', 11),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:20.567300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-7f2856e4-8b, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:20.568961 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-7f2856e4-8b, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:20.580381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-7f2856e4-8b, col_values=(('other_config', {'net_uuid': '93fca803-def7-462d-b519-0eb07f4ac511', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '11', 'segmentation_id': '189'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:20.595330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade578f,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 28}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:20.597839 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: cd34646e-9957-4ab9-b15e-f0afcfd59c3b {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:14:20.599925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port cd34646e-9957-4ab9-b15e-f0afcfd59c3b updated. Details: {'device': 'cd34646e-9957-4ab9-b15e-f0afcfd59c3b', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-dd0b2869-d6c7-4142-bc77-f5ba8b31cfeb', 'network_id': 'dd0b2869-d6c7-4142-bc77-f5ba8b31cfeb', 'port_id': 'cd34646e-9957-4ab9-b15e-f0afcfd59c3b', 'mac_address': 'fa:16:3e:1d:7d:67', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 190, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '41b00470-0fa1-4d8a-8c47-37a6136cdce6', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Sep 04 01:14:20.600784 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Assigning 12 as local vlan for net-id=dd0b2869-d6c7-4142-bc77-f5ba8b31cfeb, seg-id=190 Sep 04 01:14:20.605720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0x1fd38c11,OFPFlowMod(buffer_id=4294967295,command=0,cookie=6561907047025962751,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4286), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4108}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:20.612181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0xeade5791,OFPFlowMod(buffer_id=4294967295,command=0,cookie=6887031442322345889,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4108)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4286}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:20.613553 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapcd34646e-99, col_values=(('tag', 12),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:20.614231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tapcd34646e-99, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:20.614959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tapcd34646e-99, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:20.631141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapcd34646e-99, col_values=(('other_config', {'net_uuid': 'dd0b2869-d6c7-4142-bc77-f5ba8b31cfeb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '12', 'segmentation_id': '190'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:20.659453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade5793,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 30}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:20.659822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:525 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 8 devices currently available. Time elapsed: 0.110 Sep 04 01:14:20.660187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Preparing device filters for 1 new devices {{(pid=107812) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 04 01:14:20.660682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Preparing filters for devices {'cd34646e-9957-4ab9-b15e-f0afcfd59c3b'} Sep 04 01:14:20.662070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information for ports dict_keys([]) {{(pid=107812) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 04 01:14:20.663493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information {{(pid=107812) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 04 01:14:20.667771 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 2 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:14:20.741537 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[060f81b9-2493-4300-a7d4-00199da522ec]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:14:20.742450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Refreshing firewall for 1 devices {{(pid=107812) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 04 01:14:20.742913 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Refresh firewall rules Sep 04 01:14:20.744536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information for ports dict_keys([]) {{(pid=107812) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 04 01:14:20.744980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information {{(pid=107812) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 04 01:14:20.748505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 2 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:14:20.833830 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[66bd1411-5980-495a-a4eb-f521e1b8e401]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:14:20.834523 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:525 - agent port security group processed in 0.284 Sep 04 01:14:20.835254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for 7f2856e4-8bb1-4647-8890-edd403bce7d0 to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 01:14:20.835764 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for cd34646e-9957-4ab9-b15e-f0afcfd59c3b to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 01:14:21.152863 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-2769f706-0fbe-477b-a122-be7eb9afb765 None None] Resource Port 82064230-2100-4279-b030-003ad6dab6f1 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=82064230-2100-4279-b030-003ad6dab6f1,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=82064230-2100-4279-b030-003ad6dab6f1,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:14:21.153956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-2769f706-0fbe-477b-a122-be7eb9afb765 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (82064230-2100-4279-b030-003ad6dab6f1), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:21.440012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-2769f706-0fbe-477b-a122-be7eb9afb765 None None] Resource Port 82064230-2100-4279-b030-003ad6dab6f1 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=82064230-2100-4279-b030-003ad6dab6f1,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=82064230-2100-4279-b030-003ad6dab6f1,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=82064230-2100-4279-b030-003ad6dab6f1,segment=NetworkSegment(c26850af-ca47-4ea8-9a33-a34f3381800e),segment_id=c26850af-ca47-4ea8-9a33-a34f3381800e)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:14:21.440681 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-2769f706-0fbe-477b-a122-be7eb9afb765 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (82064230-2100-4279-b030-003ad6dab6f1), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:21.456966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Resource Port 7f2856e4-8bb1-4647-8890-edd403bce7d0 updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:14:21.458202 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (7f2856e4-8bb1-4647-8890-edd403bce7d0), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:21.588866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-953d52cb-1876-4eab-9b89-53adda2d141c None None] Resource Port cd34646e-9957-4ab9-b15e-f0afcfd59c3b updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:14:21.589553 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-953d52cb-1876-4eab-9b89-53adda2d141c None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (cd34646e-9957-4ab9-b15e-f0afcfd59c3b), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:21.622998 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Configuration for devices up ['7f2856e4-8bb1-4647-8890-edd403bce7d0', 'cd34646e-9957-4ab9-b15e-f0afcfd59c3b'] and devices down [] completed. Sep 04 01:14:21.623422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:525 - ports processed. Elapsed:1.087 Sep 04 01:14:21.623890 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:525 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 2, 'removed': 0}}. Elapsed:1.087 Sep 04 01:14:21.800125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-799dd007-856b-40c2-a554-781eb8db2389 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:14:21Z,data_plane_status=None,description='',device_id='5588f3e0-bce0-42ce-b4bf-d971c8482e9b',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=7f8c6aaa-73de-4cf1-a59c-a00c8f32c2d8,mac_address=fa:16:3e:3f:00:e0,name='',network_id=dd0b2869-d6c7-4142-bc77-f5ba8b31cfeb,numa_affinity_policy=,project_id='abca446946bf4b32a50b47d29e71cba0',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(7f8c6aaa-73de-4cf1-a59c-a00c8f32c2d8),security_group_ids=set([]),status='DOWN',updated_at=2022-09-04T01:14:21Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:21.800751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-799dd007-856b-40c2-a554-781eb8db2389 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (7f8c6aaa-73de-4cf1-a59c-a00c8f32c2d8), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:22.062831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["7c7a1753-ddbe-4485-8b6e-6f17ac4b5e2c","insert","qg-82064230-21",["set",[]],["map",[["attached-mac","fa:16:3e:a0:05:ba"],["iface-id","82064230-2100-4279-b030-003ad6dab6f1"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:14:22.084022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["7c7a1753-ddbe-4485-8b6e-6f17ac4b5e2c","old",null,["set",[]],null],["","new","qg-82064230-21",31,["map",[["attached-mac","fa:16:3e:a0:05:ba"],["iface-id","82064230-2100-4279-b030-003ad6dab6f1"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:14:22.461670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-799dd007-856b-40c2-a554-781eb8db2389 admin admin] Received resource Port update without any changes: 7f8c6aaa-73de-4cf1-a59c-a00c8f32c2d8 {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:181}} Sep 04 01:14:22.537732 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:526 started Sep 04 01:14:22.544903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5795,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=932000000,duration_sec=1071,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:22.544903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:14:22.544903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:526 - starting polling. Elapsed:0.005 Sep 04 01:14:22.547441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:22.549903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:526 - port information retrieved. Elapsed:0.012 Sep 04 01:14:22.550295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Starting to process devices in:{'current': {'3fa24970-97a7-4f46-ac55-0b24323fa402', '82064230-2100-4279-b030-003ad6dab6f1', '5f5b2b5c-f8bd-4ca8-94f2-f4d5e3a6444d', 'cd34646e-9957-4ab9-b15e-f0afcfd59c3b', '89aa06b4-bbf1-40c2-bb48-500c3aecdf48', 'e7120691-3bea-4fb5-9cd0-62e18c24380d', '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', '7f2856e4-8bb1-4647-8890-edd403bce7d0', 'ca102ce7-433c-4029-aabf-33d944165ff1'}, 'added': {'82064230-2100-4279-b030-003ad6dab6f1'}, 'removed': set(), 'updated': {'82064230-2100-4279-b030-003ad6dab6f1', '7f2856e4-8bb1-4647-8890-edd403bce7d0', 'cd34646e-9957-4ab9-b15e-f0afcfd59c3b'}, 're_added': set()} {{(pid=107812) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 04 01:14:22.550907 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': '82064230-2100-4279-b030-003ad6dab6f1', 'device_id': '5588f3e0-bce0-42ce-b4bf-d971c8482e9b', 'network_id': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'port_id': '82064230-2100-4279-b030-003ad6dab6f1', 'mac_address': 'fa:16:3e:a0:05:ba', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '2b17f894-c374-4207-90ad-14f794c86627', 'ip_address': '172.37.7.111'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 01:14:22.551376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': '7f2856e4-8bb1-4647-8890-edd403bce7d0', 'device_id': '54174312-f04b-4db8-8dc3-1c58848b0d5e', 'network_id': '93fca803-def7-462d-b519-0eb07f4ac511', 'port_id': '7f2856e4-8bb1-4647-8890-edd403bce7d0', 'mac_address': 'fa:16:3e:29:5f:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 189, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '231765c8-800c-4149-b414-9dbe7bc03304', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 01:14:22.551850 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': 'cd34646e-9957-4ab9-b15e-f0afcfd59c3b', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-dd0b2869-d6c7-4142-bc77-f5ba8b31cfeb', 'network_id': 'dd0b2869-d6c7-4142-bc77-f5ba8b31cfeb', 'port_id': 'cd34646e-9957-4ab9-b15e-f0afcfd59c3b', 'mac_address': 'fa:16:3e:1d:7d:67', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 190, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '41b00470-0fa1-4d8a-8c47-37a6136cdce6', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 01:14:22.555042 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: 82064230-2100-4279-b030-003ad6dab6f1 {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:14:22.555431 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 82064230-2100-4279-b030-003ad6dab6f1 updated. Details: {'device': '82064230-2100-4279-b030-003ad6dab6f1', 'device_id': '5588f3e0-bce0-42ce-b4bf-d971c8482e9b', 'network_id': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'port_id': '82064230-2100-4279-b030-003ad6dab6f1', 'mac_address': 'fa:16:3e:a0:05:ba', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '2b17f894-c374-4207-90ad-14f794c86627', 'ip_address': '172.37.7.111'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 04 01:14:22.556740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-82064230-21, col_values=(('tag', 2),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:22.557263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-82064230-21, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:22.558295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-82064230-21, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:22.567187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-82064230-21, col_values=(('other_config', {'net_uuid': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:22.580562 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade5797,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 31}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:22.581127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: 7f2856e4-8bb1-4647-8890-edd403bce7d0 {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:14:22.581572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 7f2856e4-8bb1-4647-8890-edd403bce7d0 updated. Details: {'device': '7f2856e4-8bb1-4647-8890-edd403bce7d0', 'device_id': '54174312-f04b-4db8-8dc3-1c58848b0d5e', 'network_id': '93fca803-def7-462d-b519-0eb07f4ac511', 'port_id': '7f2856e4-8bb1-4647-8890-edd403bce7d0', 'mac_address': 'fa:16:3e:29:5f:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 189, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '231765c8-800c-4149-b414-9dbe7bc03304', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 11} Sep 04 01:14:22.583599 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-7f2856e4-8b, col_values=(('tag', 11),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:22.583599 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-7f2856e4-8b, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:22.583599 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-7f2856e4-8b, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:22.583956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 01:14:22.584762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-7f2856e4-8b, col_values=(('other_config', {'net_uuid': '93fca803-def7-462d-b519-0eb07f4ac511', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '189', 'tag': '11'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:22.585488 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 01:14:22.590800 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade5799,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 28}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:22.592316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: cd34646e-9957-4ab9-b15e-f0afcfd59c3b {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:14:22.592818 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port cd34646e-9957-4ab9-b15e-f0afcfd59c3b updated. Details: {'device': 'cd34646e-9957-4ab9-b15e-f0afcfd59c3b', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-dd0b2869-d6c7-4142-bc77-f5ba8b31cfeb', 'network_id': 'dd0b2869-d6c7-4142-bc77-f5ba8b31cfeb', 'port_id': 'cd34646e-9957-4ab9-b15e-f0afcfd59c3b', 'mac_address': 'fa:16:3e:1d:7d:67', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 190, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '41b00470-0fa1-4d8a-8c47-37a6136cdce6', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 12} Sep 04 01:14:22.594349 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapcd34646e-99, col_values=(('tag', 12),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:22.596284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tapcd34646e-99, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:22.599443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tapcd34646e-99, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:22.600098 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 01:14:22.603036 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapcd34646e-99, col_values=(('other_config', {'net_uuid': 'dd0b2869-d6c7-4142-bc77-f5ba8b31cfeb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '190', 'tag': '12'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:22.603919 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 01:14:22.608108 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade579b,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 30}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:22.613263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:526 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 9 devices currently available. Time elapsed: 0.058 Sep 04 01:14:22.613263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Preparing device filters for 1 new devices {{(pid=107812) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 04 01:14:22.613263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Preparing filters for devices {'82064230-2100-4279-b030-003ad6dab6f1'} Sep 04 01:14:22.613263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information for ports dict_keys([]) {{(pid=107812) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 04 01:14:22.613263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information {{(pid=107812) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 04 01:14:22.615308 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 2 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:14:22.695192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa7d603-f598-4007-824e-04eec37b3e1e]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:14:22.698843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Refreshing firewall for 2 devices {{(pid=107812) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 04 01:14:22.704470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Refresh firewall rules Sep 04 01:14:22.704470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information for ports dict_keys([]) {{(pid=107812) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 04 01:14:22.704470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information {{(pid=107812) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 04 01:14:22.707882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 4 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:14:22.764333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc55d58-bfe7-4a34-8e6b-bc244e9a482b]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:14:22.765541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:526 - agent port security group processed in 0.214 Sep 04 01:14:22.766140 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for 82064230-2100-4279-b030-003ad6dab6f1 to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 01:14:22.766542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for 7f2856e4-8bb1-4647-8890-edd403bce7d0 to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 01:14:22.766983 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for cd34646e-9957-4ab9-b15e-f0afcfd59c3b to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 01:14:22.940887 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-d1876ea4-8b9f-4eb4-842d-6ca1303cede8 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:14:22Z,description='Default security group',id=16fba316-6ae0-4e7d-9c6b-c5e2facbbaad,is_default=True,name='default',project_id='45844a6d610a4549ab7b4a200a111a9f',revision_number=1,rules=[SecurityGroupRule(13362ed8-a3a9-4438-b051-04ca454cf264),SecurityGroupRule(61ef42c8-306a-4a82-9478-2c0c62bcbf7f),SecurityGroupRule(979a4e8d-3149-436b-89f3-0b25e895c019),SecurityGroupRule(a1d4cf1c-7f68-40cc-a656-4a2c4ee06565)],shared=False,stateful=True,updated_at=2022-09-04T01:14:22Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:22.941434 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-d1876ea4-8b9f-4eb4-842d-6ca1303cede8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (16fba316-6ae0-4e7d-9c6b-c5e2facbbaad), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:22.942146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-d1876ea4-8b9f-4eb4-842d-6ca1303cede8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:14:22Z,description=,direction='egress',ethertype='IPv6',id=13362ed8-a3a9-4438-b051-04ca454cf264,normalized_cidr=None,port_range_max=,port_range_min=,project_id='45844a6d610a4549ab7b4a200a111a9f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=16fba316-6ae0-4e7d-9c6b-c5e2facbbaad,updated_at=2022-09-04T01:14:22Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:22.942685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-d1876ea4-8b9f-4eb4-842d-6ca1303cede8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (13362ed8-a3a9-4438-b051-04ca454cf264), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:22.943249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-d1876ea4-8b9f-4eb4-842d-6ca1303cede8 admin admin] Security group rule updated ['16fba316-6ae0-4e7d-9c6b-c5e2facbbaad'] Sep 04 01:14:22.944298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-d1876ea4-8b9f-4eb4-842d-6ca1303cede8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:14:22Z,description=,direction='egress',ethertype='IPv4',id=61ef42c8-306a-4a82-9478-2c0c62bcbf7f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='45844a6d610a4549ab7b4a200a111a9f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=16fba316-6ae0-4e7d-9c6b-c5e2facbbaad,updated_at=2022-09-04T01:14:22Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:22.945154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-d1876ea4-8b9f-4eb4-842d-6ca1303cede8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (61ef42c8-306a-4a82-9478-2c0c62bcbf7f), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:22.945735 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-d1876ea4-8b9f-4eb4-842d-6ca1303cede8 admin admin] Security group rule updated ['16fba316-6ae0-4e7d-9c6b-c5e2facbbaad'] Sep 04 01:14:22.946822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-d1876ea4-8b9f-4eb4-842d-6ca1303cede8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:14:22Z,description=,direction='ingress',ethertype='IPv4',id=979a4e8d-3149-436b-89f3-0b25e895c019,normalized_cidr=None,port_range_max=,port_range_min=,project_id='45844a6d610a4549ab7b4a200a111a9f',protocol=,remote_address_group_id=,remote_group_id=16fba316-6ae0-4e7d-9c6b-c5e2facbbaad,remote_ip_prefix=,revision_number=0,security_group_id=16fba316-6ae0-4e7d-9c6b-c5e2facbbaad,updated_at=2022-09-04T01:14:22Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:22.947391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-d1876ea4-8b9f-4eb4-842d-6ca1303cede8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (979a4e8d-3149-436b-89f3-0b25e895c019), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:22.947835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-d1876ea4-8b9f-4eb4-842d-6ca1303cede8 admin admin] Security group rule updated ['16fba316-6ae0-4e7d-9c6b-c5e2facbbaad'] Sep 04 01:14:22.948597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-d1876ea4-8b9f-4eb4-842d-6ca1303cede8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:14:22Z,description=,direction='ingress',ethertype='IPv6',id=a1d4cf1c-7f68-40cc-a656-4a2c4ee06565,normalized_cidr=None,port_range_max=,port_range_min=,project_id='45844a6d610a4549ab7b4a200a111a9f',protocol=,remote_address_group_id=,remote_group_id=16fba316-6ae0-4e7d-9c6b-c5e2facbbaad,remote_ip_prefix=,revision_number=0,security_group_id=16fba316-6ae0-4e7d-9c6b-c5e2facbbaad,updated_at=2022-09-04T01:14:22Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:22.949040 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-d1876ea4-8b9f-4eb4-842d-6ca1303cede8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (a1d4cf1c-7f68-40cc-a656-4a2c4ee06565), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:22.949454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-d1876ea4-8b9f-4eb4-842d-6ca1303cede8 admin admin] Security group rule updated ['16fba316-6ae0-4e7d-9c6b-c5e2facbbaad'] Sep 04 01:14:23.202997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Resource Port 82064230-2100-4279-b030-003ad6dab6f1 updated (revision_number 3->4). Old fields: {'status': 'DOWN', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=82064230-2100-4279-b030-003ad6dab6f1,segment=NetworkSegment(c26850af-ca47-4ea8-9a33-a34f3381800e),segment_id=c26850af-ca47-4ea8-9a33-a34f3381800e)]} New fields: {'status': 'ACTIVE', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=82064230-2100-4279-b030-003ad6dab6f1,segment=NetworkSegment(c26850af-ca47-4ea8-9a33-a34f3381800e),segment_id=c26850af-ca47-4ea8-9a33-a34f3381800e)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:14:23.203391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (82064230-2100-4279-b030-003ad6dab6f1), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:23.248631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-074b8158-5df3-4113-95de-185fc5e5f6af admin admin] Resource SecurityGroup deleted: 16fba316-6ae0-4e7d-9c6b-c5e2facbbaad {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:23.250066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-074b8158-5df3-4113-95de-185fc5e5f6af admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (16fba316-6ae0-4e7d-9c6b-c5e2facbbaad), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:23.250926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-074b8158-5df3-4113-95de-185fc5e5f6af admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('16fba316-6ae0-4e7d-9c6b-c5e2facbbaad',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:14:23.296016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-074b8158-5df3-4113-95de-185fc5e5f6af admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('16fba316-6ae0-4e7d-9c6b-c5e2facbbaad',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:14:23.296453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-074b8158-5df3-4113-95de-185fc5e5f6af admin admin] Resource SecurityGroupRule deleted: 13362ed8-a3a9-4438-b051-04ca454cf264 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:23.300476 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-074b8158-5df3-4113-95de-185fc5e5f6af admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (13362ed8-a3a9-4438-b051-04ca454cf264), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:23.300849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-074b8158-5df3-4113-95de-185fc5e5f6af admin admin] Security group rule updated ['16fba316-6ae0-4e7d-9c6b-c5e2facbbaad'] Sep 04 01:14:23.301409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-074b8158-5df3-4113-95de-185fc5e5f6af admin admin] Resource SecurityGroupRule deleted: 61ef42c8-306a-4a82-9478-2c0c62bcbf7f {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:23.301825 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-074b8158-5df3-4113-95de-185fc5e5f6af admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (61ef42c8-306a-4a82-9478-2c0c62bcbf7f), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:23.302157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-074b8158-5df3-4113-95de-185fc5e5f6af admin admin] Security group rule updated ['16fba316-6ae0-4e7d-9c6b-c5e2facbbaad'] Sep 04 01:14:23.302585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-074b8158-5df3-4113-95de-185fc5e5f6af admin admin] Resource SecurityGroupRule deleted: 979a4e8d-3149-436b-89f3-0b25e895c019 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:23.303528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-074b8158-5df3-4113-95de-185fc5e5f6af admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (979a4e8d-3149-436b-89f3-0b25e895c019), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:23.303873 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-074b8158-5df3-4113-95de-185fc5e5f6af admin admin] Security group rule updated ['16fba316-6ae0-4e7d-9c6b-c5e2facbbaad'] Sep 04 01:14:23.304300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-074b8158-5df3-4113-95de-185fc5e5f6af admin admin] Resource SecurityGroupRule deleted: a1d4cf1c-7f68-40cc-a656-4a2c4ee06565 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:23.304653 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-074b8158-5df3-4113-95de-185fc5e5f6af admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (a1d4cf1c-7f68-40cc-a656-4a2c4ee06565), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:23.305268 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-074b8158-5df3-4113-95de-185fc5e5f6af admin admin] Security group rule updated ['16fba316-6ae0-4e7d-9c6b-c5e2facbbaad'] Sep 04 01:14:23.439791 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Configuration for devices up ['82064230-2100-4279-b030-003ad6dab6f1', '7f2856e4-8bb1-4647-8890-edd403bce7d0', 'cd34646e-9957-4ab9-b15e-f0afcfd59c3b'] and devices down [] completed. Sep 04 01:14:23.440199 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:526 - ports processed. Elapsed:0.903 Sep 04 01:14:23.440860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:526 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 3, 'removed': 0}}. Elapsed:0.903 Sep 04 01:14:24.540573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:527 started Sep 04 01:14:24.542121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade579d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=933000000,duration_sec=1073,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:24.542844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:14:24.543313 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:527 - starting polling. Elapsed:0.005 Sep 04 01:14:24.545805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:24.555232 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:527 - port information retrieved. Elapsed:0.017 Sep 04 01:14:24.556888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Starting to process devices in:{'current': {'3fa24970-97a7-4f46-ac55-0b24323fa402', '82064230-2100-4279-b030-003ad6dab6f1', '5f5b2b5c-f8bd-4ca8-94f2-f4d5e3a6444d', 'cd34646e-9957-4ab9-b15e-f0afcfd59c3b', '89aa06b4-bbf1-40c2-bb48-500c3aecdf48', 'e7120691-3bea-4fb5-9cd0-62e18c24380d', '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', '7f2856e4-8bb1-4647-8890-edd403bce7d0', 'ca102ce7-433c-4029-aabf-33d944165ff1'}, 'added': set(), 'removed': set(), 'updated': {'82064230-2100-4279-b030-003ad6dab6f1'}, 're_added': set()} {{(pid=107812) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 04 01:14:24.558022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': '82064230-2100-4279-b030-003ad6dab6f1', 'device_id': '5588f3e0-bce0-42ce-b4bf-d971c8482e9b', 'network_id': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'port_id': '82064230-2100-4279-b030-003ad6dab6f1', 'mac_address': 'fa:16:3e:a0:05:ba', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '2b17f894-c374-4207-90ad-14f794c86627', 'ip_address': '172.37.7.111'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 01:14:24.565848 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: 82064230-2100-4279-b030-003ad6dab6f1 {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:14:24.570651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 82064230-2100-4279-b030-003ad6dab6f1 updated. Details: {'device': '82064230-2100-4279-b030-003ad6dab6f1', 'device_id': '5588f3e0-bce0-42ce-b4bf-d971c8482e9b', 'network_id': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'port_id': '82064230-2100-4279-b030-003ad6dab6f1', 'mac_address': 'fa:16:3e:a0:05:ba', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '2b17f894-c374-4207-90ad-14f794c86627', 'ip_address': '172.37.7.111'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 04 01:14:24.572135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-82064230-21, col_values=(('tag', 2),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:24.572572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-82064230-21, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:24.572976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-82064230-21, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:24.573460 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 01:14:24.574238 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-82064230-21, col_values=(('other_config', {'net_uuid': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:24.574888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 01:14:24.583202 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade579f,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 31}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:24.589957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:527 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 9 devices currently available. Time elapsed: 0.032 Sep 04 01:14:24.590604 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Refreshing firewall for 1 devices {{(pid=107812) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 04 01:14:24.591723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Refresh firewall rules Sep 04 01:14:24.593066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information for ports dict_keys([]) {{(pid=107812) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 04 01:14:24.593533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information {{(pid=107812) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 04 01:14:24.596552 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 2 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:14:24.669955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ca147d-a40b-4ef3-bec1-9ae46307e69b]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:14:24.670812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:527 - agent port security group processed in 0.113 Sep 04 01:14:24.671687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for 82064230-2100-4279-b030-003ad6dab6f1 to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 01:14:24.748760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-8bd6bc21-abc2-412b-aa5c-8f1fcbfb84f4 None None] Resource Port 7f8c6aaa-73de-4cf1-a59c-a00c8f32c2d8 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=7f8c6aaa-73de-4cf1-a59c-a00c8f32c2d8,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=7f8c6aaa-73de-4cf1-a59c-a00c8f32c2d8,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:14:24.749429 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-8bd6bc21-abc2-412b-aa5c-8f1fcbfb84f4 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (7f8c6aaa-73de-4cf1-a59c-a00c8f32c2d8), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:24.940818 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Configuration for devices up ['82064230-2100-4279-b030-003ad6dab6f1'] and devices down [] completed. Sep 04 01:14:24.941248 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:527 - ports processed. Elapsed:0.403 Sep 04 01:14:24.941788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:527 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.403 Sep 04 01:14:25.080947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-93ca8012-fbdf-482e-b85e-3a000eba7d77 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:14:24Z,description='Default security group',id=36f6ec18-1e64-4839-9f90-49478f98ae2a,is_default=True,name='default',project_id='2506b96ac13541e6a7a47c5aedca67e5',revision_number=1,rules=[SecurityGroupRule(34ab7f34-ef77-4b0c-97bd-62402bb4214a),SecurityGroupRule(af87b511-30d8-43b7-8b71-9dfcde73a7c1),SecurityGroupRule(cdd6c075-f08b-44c9-b98c-3accbc29b0a4),SecurityGroupRule(e1751ec9-022c-4598-a2c7-12e568aa1dfc)],shared=False,stateful=True,updated_at=2022-09-04T01:14:24Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:25.081786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-93ca8012-fbdf-482e-b85e-3a000eba7d77 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (36f6ec18-1e64-4839-9f90-49478f98ae2a), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:25.082300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-93ca8012-fbdf-482e-b85e-3a000eba7d77 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:14:24Z,description=,direction='egress',ethertype='IPv4',id=34ab7f34-ef77-4b0c-97bd-62402bb4214a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2506b96ac13541e6a7a47c5aedca67e5',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=36f6ec18-1e64-4839-9f90-49478f98ae2a,updated_at=2022-09-04T01:14:24Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:25.082656 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-93ca8012-fbdf-482e-b85e-3a000eba7d77 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (34ab7f34-ef77-4b0c-97bd-62402bb4214a), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:25.082990 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-93ca8012-fbdf-482e-b85e-3a000eba7d77 admin admin] Security group rule updated ['36f6ec18-1e64-4839-9f90-49478f98ae2a'] Sep 04 01:14:25.083811 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-93ca8012-fbdf-482e-b85e-3a000eba7d77 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:14:24Z,description=,direction='ingress',ethertype='IPv4',id=af87b511-30d8-43b7-8b71-9dfcde73a7c1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2506b96ac13541e6a7a47c5aedca67e5',protocol=,remote_address_group_id=,remote_group_id=36f6ec18-1e64-4839-9f90-49478f98ae2a,remote_ip_prefix=,revision_number=0,security_group_id=36f6ec18-1e64-4839-9f90-49478f98ae2a,updated_at=2022-09-04T01:14:24Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:25.084167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-93ca8012-fbdf-482e-b85e-3a000eba7d77 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (af87b511-30d8-43b7-8b71-9dfcde73a7c1), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:25.084490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-93ca8012-fbdf-482e-b85e-3a000eba7d77 admin admin] Security group rule updated ['36f6ec18-1e64-4839-9f90-49478f98ae2a'] Sep 04 01:14:25.085532 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-93ca8012-fbdf-482e-b85e-3a000eba7d77 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:14:24Z,description=,direction='ingress',ethertype='IPv6',id=cdd6c075-f08b-44c9-b98c-3accbc29b0a4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2506b96ac13541e6a7a47c5aedca67e5',protocol=,remote_address_group_id=,remote_group_id=36f6ec18-1e64-4839-9f90-49478f98ae2a,remote_ip_prefix=,revision_number=0,security_group_id=36f6ec18-1e64-4839-9f90-49478f98ae2a,updated_at=2022-09-04T01:14:24Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:25.085891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-93ca8012-fbdf-482e-b85e-3a000eba7d77 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (cdd6c075-f08b-44c9-b98c-3accbc29b0a4), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:25.086213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-93ca8012-fbdf-482e-b85e-3a000eba7d77 admin admin] Security group rule updated ['36f6ec18-1e64-4839-9f90-49478f98ae2a'] Sep 04 01:14:25.086924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-93ca8012-fbdf-482e-b85e-3a000eba7d77 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:14:24Z,description=,direction='egress',ethertype='IPv6',id=e1751ec9-022c-4598-a2c7-12e568aa1dfc,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2506b96ac13541e6a7a47c5aedca67e5',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=36f6ec18-1e64-4839-9f90-49478f98ae2a,updated_at=2022-09-04T01:14:24Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:25.087247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-93ca8012-fbdf-482e-b85e-3a000eba7d77 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (e1751ec9-022c-4598-a2c7-12e568aa1dfc), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:25.093571 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-93ca8012-fbdf-482e-b85e-3a000eba7d77 admin admin] Security group rule updated ['36f6ec18-1e64-4839-9f90-49478f98ae2a'] Sep 04 01:14:25.258068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-8bd6bc21-abc2-412b-aa5c-8f1fcbfb84f4 None None] Resource Port 7f8c6aaa-73de-4cf1-a59c-a00c8f32c2d8 updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=7f8c6aaa-73de-4cf1-a59c-a00c8f32c2d8,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=7f8c6aaa-73de-4cf1-a59c-a00c8f32c2d8,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=7f8c6aaa-73de-4cf1-a59c-a00c8f32c2d8,segment=NetworkSegment(1937bb3a-afad-401d-a1b2-924e74017550),segment_id=1937bb3a-afad-401d-a1b2-924e74017550)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:14:25.258648 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-8bd6bc21-abc2-412b-aa5c-8f1fcbfb84f4 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (7f8c6aaa-73de-4cf1-a59c-a00c8f32c2d8), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:25.285259 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-93ca8012-fbdf-482e-b85e-3a000eba7d77 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-04T01:14:24Z,description='',dns_domain=None,id=ca88993b-9210-4173-b062-c40cdf9e1da6,mtu=1500,name='tempest-TestVolumeBootPattern-658319535-network',project_id='2506b96ac13541e6a7a47c5aedca67e5',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(ca88993b-9210-4173-b062-c40cdf9e1da6),segments=[NetworkSegment(ec3b99f9-cd00-455f-aba9-a56f7e7f2980)],shared=False,status='ACTIVE',updated_at=2022-09-04T01:14:25Z,vlan_transparent=) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:25.285983 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-93ca8012-fbdf-482e-b85e-3a000eba7d77 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533'] for Network (ca88993b-9210-4173-b062-c40cdf9e1da6), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:25.445931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager [None req-93ca8012-fbdf-482e-b85e-3a000eba7d77 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network ca88993b-9210-4173-b062-c40cdf9e1da6 with segmentation id not found. Sep 04 01:14:25.445931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 04 01:14:25.445931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 04 01:14:25.445931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 04 01:14:25.445931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 04 01:14:25.445931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 04 01:14:25.445931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 04 01:14:25.445931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 04 01:14:25.445931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 04 01:14:25.445931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 04 01:14:25.445931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 04 01:14:25.445931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 04 01:14:25.445931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 04 01:14:25.446926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 04 01:14:25.446926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 04 01:14:25.446926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 04 01:14:25.446926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network ca88993b-9210-4173-b062-c40cdf9e1da6 with segmentation id not found. Sep 04 01:14:25.446926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager Sep 04 01:14:25.654959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["25fcb871-7014-4f1b-9a58-538223dc3e47","insert","qr-7f8c6aaa-73",["set",[]],["map",[["attached-mac","fa:16:3e:3f:00:e0"],["iface-id","7f8c6aaa-73de-4cf1-a59c-a00c8f32c2d8"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:14:25.681830 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["25fcb871-7014-4f1b-9a58-538223dc3e47","old",null,["set",[]],null],["","new","qr-7f8c6aaa-73",32,["map",[["attached-mac","fa:16:3e:3f:00:e0"],["iface-id","7f8c6aaa-73de-4cf1-a59c-a00c8f32c2d8"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:14:25.933598 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-493d3b01-2635-4f96-854f-5342f129fedf admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(3d586e6f-eae5-4559-a1c2-6a9c617578b9)],cidr=172.20.0.0/28,created_at=2022-09-04T01:14:25Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=53b46299-8023-4a0f-bdf3-86b9a7286814,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-TestVolumeBootPattern-658319535-subnet',network_id=ca88993b-9210-4173-b062-c40cdf9e1da6,project_id='2506b96ac13541e6a7a47c5aedca67e5',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-04T01:14:25Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:25.934737 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-493d3b01-2635-4f96-854f-5342f129fedf admin admin] Publish callbacks [] for Subnet (53b46299-8023-4a0f-bdf3-86b9a7286814), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:26.539783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:528 started Sep 04 01:14:26.546682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade57a1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=935000000,duration_sec=1075,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:26.547654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:14:26.548741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:528 - starting polling. Elapsed:0.009 Sep 04 01:14:26.551659 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:26.554319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:528 - port information retrieved. Elapsed:0.015 Sep 04 01:14:26.555065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Starting to process devices in:{'current': {'3fa24970-97a7-4f46-ac55-0b24323fa402', '82064230-2100-4279-b030-003ad6dab6f1', '5f5b2b5c-f8bd-4ca8-94f2-f4d5e3a6444d', 'cd34646e-9957-4ab9-b15e-f0afcfd59c3b', '89aa06b4-bbf1-40c2-bb48-500c3aecdf48', 'e7120691-3bea-4fb5-9cd0-62e18c24380d', '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', '7f8c6aaa-73de-4cf1-a59c-a00c8f32c2d8', '7f2856e4-8bb1-4647-8890-edd403bce7d0', 'ca102ce7-433c-4029-aabf-33d944165ff1'}, 'added': {'7f8c6aaa-73de-4cf1-a59c-a00c8f32c2d8'}, 'removed': set(), 'updated': {'7f8c6aaa-73de-4cf1-a59c-a00c8f32c2d8'}, 're_added': set()} {{(pid=107812) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 04 01:14:26.556385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': '7f8c6aaa-73de-4cf1-a59c-a00c8f32c2d8', 'device_id': '5588f3e0-bce0-42ce-b4bf-d971c8482e9b', 'network_id': 'dd0b2869-d6c7-4142-bc77-f5ba8b31cfeb', 'port_id': '7f8c6aaa-73de-4cf1-a59c-a00c8f32c2d8', 'mac_address': 'fa:16:3e:3f:00:e0', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 190, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '41b00470-0fa1-4d8a-8c47-37a6136cdce6', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 01:14:26.562072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: 7f8c6aaa-73de-4cf1-a59c-a00c8f32c2d8 {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:14:26.562072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 7f8c6aaa-73de-4cf1-a59c-a00c8f32c2d8 updated. Details: {'device': '7f8c6aaa-73de-4cf1-a59c-a00c8f32c2d8', 'device_id': '5588f3e0-bce0-42ce-b4bf-d971c8482e9b', 'network_id': 'dd0b2869-d6c7-4142-bc77-f5ba8b31cfeb', 'port_id': '7f8c6aaa-73de-4cf1-a59c-a00c8f32c2d8', 'mac_address': 'fa:16:3e:3f:00:e0', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 190, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '41b00470-0fa1-4d8a-8c47-37a6136cdce6', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 12} Sep 04 01:14:26.562072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-7f8c6aaa-73, col_values=(('tag', 12),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:26.562444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-7f8c6aaa-73, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:26.562846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-7f8c6aaa-73, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:26.570023 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-7f8c6aaa-73, col_values=(('other_config', {'net_uuid': 'dd0b2869-d6c7-4142-bc77-f5ba8b31cfeb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '12', 'segmentation_id': '190'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:26.590682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade57a3,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 32}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:26.591964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:528 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 10 devices currently available. Time elapsed: 0.036 Sep 04 01:14:26.592472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Preparing device filters for 1 new devices {{(pid=107812) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 04 01:14:26.592921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Preparing filters for devices {'7f8c6aaa-73de-4cf1-a59c-a00c8f32c2d8'} Sep 04 01:14:26.595768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information for ports dict_keys([]) {{(pid=107812) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 04 01:14:26.595768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information {{(pid=107812) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 04 01:14:26.599991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 2 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:14:26.699145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6afb5e6-a58c-48e1-b89d-027b17d73a39]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:14:26.699811 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:528 - agent port security group processed in 0.144 Sep 04 01:14:26.702228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for 7f8c6aaa-73de-4cf1-a59c-a00c8f32c2d8 to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 01:14:27.147436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Configuration for devices up ['7f8c6aaa-73de-4cf1-a59c-a00c8f32c2d8'] and devices down [] completed. Sep 04 01:14:27.147946 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:528 - ports processed. Elapsed:0.608 Sep 04 01:14:27.149532 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:528 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.610 Sep 04 01:14:27.160096 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c87960f2-e345-445a-bdc4-23f181a3b391 None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:14:26Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-ca88993b-9210-4173-b062-c40cdf9e1da6',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=996205b2-4ccc-4913-8458-2e4f1e0e6687,mac_address=fa:16:3e:3c:e3:90,name='',network_id=ca88993b-9210-4173-b062-c40cdf9e1da6,numa_affinity_policy=,project_id='2506b96ac13541e6a7a47c5aedca67e5',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(996205b2-4ccc-4913-8458-2e4f1e0e6687),security_group_ids=set([]),status='DOWN',updated_at=2022-09-04T01:14:26Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:27.160479 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-c87960f2-e345-445a-bdc4-23f181a3b391 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (996205b2-4ccc-4913-8458-2e4f1e0e6687), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:27.332212 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Resource Port 7f8c6aaa-73de-4cf1-a59c-a00c8f32c2d8 updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:14:27.332887 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (7f8c6aaa-73de-4cf1-a59c-a00c8f32c2d8), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:27.611755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c87960f2-e345-445a-bdc4-23f181a3b391 None None] Resource Port 996205b2-4ccc-4913-8458-2e4f1e0e6687 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=996205b2-4ccc-4913-8458-2e4f1e0e6687,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=996205b2-4ccc-4913-8458-2e4f1e0e6687,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=996205b2-4ccc-4913-8458-2e4f1e0e6687,segment=NetworkSegment(ec3b99f9-cd00-455f-aba9-a56f7e7f2980),segment_id=ec3b99f9-cd00-455f-aba9-a56f7e7f2980)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:14:27.617251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-c87960f2-e345-445a-bdc4-23f181a3b391 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (996205b2-4ccc-4913-8458-2e4f1e0e6687), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:27.748673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["08f4d551-8d43-435c-832a-dee184c841f7","insert","tap996205b2-4c",["set",[]],["map",[["attached-mac","fa:16:3e:3c:e3:90"],["iface-id","996205b2-4ccc-4913-8458-2e4f1e0e6687"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:14:27.751028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["08f4d551-8d43-435c-832a-dee184c841f7","old",null,["set",[]],null],["","new","tap996205b2-4c",33,["map",[["attached-mac","fa:16:3e:3c:e3:90"],["iface-id","996205b2-4ccc-4913-8458-2e4f1e0e6687"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:14:28.238323 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-5621f2f7-bea5-425b-9980-43d620c70418 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:14:27Z,data_plane_status=None,description='',device_id='6dabf8dd-965b-4215-badb-62721cb59027',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=491c36f8-0074-4f7c-870c-6d117c1f71b6,mac_address=fa:16:3e:6d:92:3b,name='',network_id=e8e0564a-d5c9-4fe0-b2d4-538f45096708,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(491c36f8-0074-4f7c-870c-6d117c1f71b6),security_group_ids=set([]),status='DOWN',updated_at=2022-09-04T01:14:27Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:28.238710 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-5621f2f7-bea5-425b-9980-43d620c70418 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (491c36f8-0074-4f7c-870c-6d117c1f71b6), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:28.541299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:529 started Sep 04 01:14:28.544955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade57a5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=935000000,duration_sec=1077,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:28.545684 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:14:28.546335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:529 - starting polling. Elapsed:0.005 Sep 04 01:14:28.556526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:28.558999 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:529 - port information retrieved. Elapsed:0.018 Sep 04 01:14:28.559396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Starting to process devices in:{'current': {'3fa24970-97a7-4f46-ac55-0b24323fa402', '82064230-2100-4279-b030-003ad6dab6f1', '5f5b2b5c-f8bd-4ca8-94f2-f4d5e3a6444d', 'cd34646e-9957-4ab9-b15e-f0afcfd59c3b', '89aa06b4-bbf1-40c2-bb48-500c3aecdf48', 'e7120691-3bea-4fb5-9cd0-62e18c24380d', '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', '996205b2-4ccc-4913-8458-2e4f1e0e6687', '7f8c6aaa-73de-4cf1-a59c-a00c8f32c2d8', '7f2856e4-8bb1-4647-8890-edd403bce7d0', 'ca102ce7-433c-4029-aabf-33d944165ff1'}, 'added': {'996205b2-4ccc-4913-8458-2e4f1e0e6687'}, 'removed': set(), 'updated': {'996205b2-4ccc-4913-8458-2e4f1e0e6687', '7f8c6aaa-73de-4cf1-a59c-a00c8f32c2d8'}, 're_added': set()} {{(pid=107812) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 04 01:14:28.563836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': '996205b2-4ccc-4913-8458-2e4f1e0e6687', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-ca88993b-9210-4173-b062-c40cdf9e1da6', 'network_id': 'ca88993b-9210-4173-b062-c40cdf9e1da6', 'port_id': '996205b2-4ccc-4913-8458-2e4f1e0e6687', 'mac_address': 'fa:16:3e:3c:e3:90', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 150, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '53b46299-8023-4a0f-bdf3-86b9a7286814', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 01:14:28.564480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': '7f8c6aaa-73de-4cf1-a59c-a00c8f32c2d8', 'device_id': '5588f3e0-bce0-42ce-b4bf-d971c8482e9b', 'network_id': 'dd0b2869-d6c7-4142-bc77-f5ba8b31cfeb', 'port_id': '7f8c6aaa-73de-4cf1-a59c-a00c8f32c2d8', 'mac_address': 'fa:16:3e:3f:00:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 190, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '41b00470-0fa1-4d8a-8c47-37a6136cdce6', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 01:14:28.567250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: 996205b2-4ccc-4913-8458-2e4f1e0e6687 {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:14:28.569537 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 996205b2-4ccc-4913-8458-2e4f1e0e6687 updated. Details: {'device': '996205b2-4ccc-4913-8458-2e4f1e0e6687', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-ca88993b-9210-4173-b062-c40cdf9e1da6', 'network_id': 'ca88993b-9210-4173-b062-c40cdf9e1da6', 'port_id': '996205b2-4ccc-4913-8458-2e4f1e0e6687', 'mac_address': 'fa:16:3e:3c:e3:90', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 150, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '53b46299-8023-4a0f-bdf3-86b9a7286814', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Sep 04 01:14:28.571641 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Assigning 13 as local vlan for net-id=ca88993b-9210-4173-b062-c40cdf9e1da6, seg-id=150 Sep 04 01:14:28.584892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0x1fd38c13,OFPFlowMod(buffer_id=4294967295,command=0,cookie=6561907047025962751,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4246), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4109}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:28.588160 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0xeade57a7,OFPFlowMod(buffer_id=4294967295,command=0,cookie=6887031442322345889,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4109)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4246}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:28.589435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap996205b2-4c, col_values=(('tag', 13),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:28.589966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap996205b2-4c, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:28.590610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap996205b2-4c, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:28.603538 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap996205b2-4c, col_values=(('other_config', {'net_uuid': 'ca88993b-9210-4173-b062-c40cdf9e1da6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '13', 'segmentation_id': '150'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:28.617749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade57a9,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 33}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:28.618228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: 7f8c6aaa-73de-4cf1-a59c-a00c8f32c2d8 {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:14:28.618910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 7f8c6aaa-73de-4cf1-a59c-a00c8f32c2d8 updated. Details: {'device': '7f8c6aaa-73de-4cf1-a59c-a00c8f32c2d8', 'device_id': '5588f3e0-bce0-42ce-b4bf-d971c8482e9b', 'network_id': 'dd0b2869-d6c7-4142-bc77-f5ba8b31cfeb', 'port_id': '7f8c6aaa-73de-4cf1-a59c-a00c8f32c2d8', 'mac_address': 'fa:16:3e:3f:00:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 190, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '41b00470-0fa1-4d8a-8c47-37a6136cdce6', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 12} Sep 04 01:14:28.620032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-7f8c6aaa-73, col_values=(('tag', 12),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:28.620692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-7f8c6aaa-73, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:28.621348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-7f8c6aaa-73, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:28.622054 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 01:14:28.622995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-7f8c6aaa-73, col_values=(('other_config', {'net_uuid': 'dd0b2869-d6c7-4142-bc77-f5ba8b31cfeb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '190', 'tag': '12'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:28.623942 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 01:14:28.626851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade57ab,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 32}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:28.627215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:529 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 11 devices currently available. Time elapsed: 0.067 Sep 04 01:14:28.627571 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Preparing device filters for 1 new devices {{(pid=107812) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 04 01:14:28.627873 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Preparing filters for devices {'996205b2-4ccc-4913-8458-2e4f1e0e6687'} Sep 04 01:14:28.629828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information for ports dict_keys([]) {{(pid=107812) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 04 01:14:28.630101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information {{(pid=107812) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 04 01:14:28.633228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 2 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:14:28.679054 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[152233c9-7968-48c8-bacc-b1bc1b2bffd7]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:14:28.679621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Refreshing firewall for 1 devices {{(pid=107812) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 04 01:14:28.679932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Refresh firewall rules Sep 04 01:14:28.681066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information for ports dict_keys([]) {{(pid=107812) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 04 01:14:28.681434 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information {{(pid=107812) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 04 01:14:28.685440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 2 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:14:28.768390 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[761d1320-bc77-4d57-af67-42b06eb460bb]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:14:28.769262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:529 - agent port security group processed in 0.209 Sep 04 01:14:28.769916 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for 996205b2-4ccc-4913-8458-2e4f1e0e6687 to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 01:14:28.770241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for 7f8c6aaa-73de-4cf1-a59c-a00c8f32c2d8 to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 01:14:29.588361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-453832fd-db37-4ecc-8384-8139c71c09a2 None None] Resource Port 996205b2-4ccc-4913-8458-2e4f1e0e6687 updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:14:29.589113 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-453832fd-db37-4ecc-8384-8139c71c09a2 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (996205b2-4ccc-4913-8458-2e4f1e0e6687), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:30.291270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Configuration for devices up ['996205b2-4ccc-4913-8458-2e4f1e0e6687', '7f8c6aaa-73de-4cf1-a59c-a00c8f32c2d8'] and devices down [] completed. Sep 04 01:14:30.292454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:529 - ports processed. Elapsed:1.751 Sep 04 01:14:30.292790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:529 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 2, 'removed': 0}}. Elapsed:1.752 Sep 04 01:14:30.448254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-a78afa89-e74c-4991-b24e-4d9bfe5db65c None None] Resource Port 491c36f8-0074-4f7c-870c-6d117c1f71b6 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=491c36f8-0074-4f7c-870c-6d117c1f71b6,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=491c36f8-0074-4f7c-870c-6d117c1f71b6,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:14:30.448913 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-a78afa89-e74c-4991-b24e-4d9bfe5db65c None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (491c36f8-0074-4f7c-870c-6d117c1f71b6), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:30.455273 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-cf1e1ee5-1574-4dd4-a770-b30e46b43428 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:14:29Z,data_plane_status=None,description='',device_id='6dabf8dd-965b-4215-badb-62721cb59027',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=c73d8972-0881-4e30-8303-b09f2c82f2f0,mac_address=fa:16:3e:b7:43:f1,name='',network_id=ca88993b-9210-4173-b062-c40cdf9e1da6,numa_affinity_policy=,project_id='2506b96ac13541e6a7a47c5aedca67e5',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(c73d8972-0881-4e30-8303-b09f2c82f2f0),security_group_ids=set([]),status='DOWN',updated_at=2022-09-04T01:14:30Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:30.457213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-cf1e1ee5-1574-4dd4-a770-b30e46b43428 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (c73d8972-0881-4e30-8303-b09f2c82f2f0), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:30.542402 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:530 started Sep 04 01:14:30.547161 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade57ad,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=937000000,duration_sec=1079,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:30.548667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:14:30.549135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:530 - starting polling. Elapsed:0.007 Sep 04 01:14:30.554533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:30.558336 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:530 - port information retrieved. Elapsed:0.016 Sep 04 01:14:30.561335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Starting to process devices in:{'current': {'3fa24970-97a7-4f46-ac55-0b24323fa402', '82064230-2100-4279-b030-003ad6dab6f1', '5f5b2b5c-f8bd-4ca8-94f2-f4d5e3a6444d', 'cd34646e-9957-4ab9-b15e-f0afcfd59c3b', '89aa06b4-bbf1-40c2-bb48-500c3aecdf48', 'e7120691-3bea-4fb5-9cd0-62e18c24380d', '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', '996205b2-4ccc-4913-8458-2e4f1e0e6687', '7f8c6aaa-73de-4cf1-a59c-a00c8f32c2d8', '7f2856e4-8bb1-4647-8890-edd403bce7d0', 'ca102ce7-433c-4029-aabf-33d944165ff1'}, 'added': set(), 'removed': set(), 'updated': {'996205b2-4ccc-4913-8458-2e4f1e0e6687'}, 're_added': set()} {{(pid=107812) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 04 01:14:30.561961 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': '996205b2-4ccc-4913-8458-2e4f1e0e6687', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-ca88993b-9210-4173-b062-c40cdf9e1da6', 'network_id': 'ca88993b-9210-4173-b062-c40cdf9e1da6', 'port_id': '996205b2-4ccc-4913-8458-2e4f1e0e6687', 'mac_address': 'fa:16:3e:3c:e3:90', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 150, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '53b46299-8023-4a0f-bdf3-86b9a7286814', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 01:14:30.564343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: 996205b2-4ccc-4913-8458-2e4f1e0e6687 {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:14:30.564682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 996205b2-4ccc-4913-8458-2e4f1e0e6687 updated. Details: {'device': '996205b2-4ccc-4913-8458-2e4f1e0e6687', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-ca88993b-9210-4173-b062-c40cdf9e1da6', 'network_id': 'ca88993b-9210-4173-b062-c40cdf9e1da6', 'port_id': '996205b2-4ccc-4913-8458-2e4f1e0e6687', 'mac_address': 'fa:16:3e:3c:e3:90', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 150, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '53b46299-8023-4a0f-bdf3-86b9a7286814', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 13} Sep 04 01:14:30.567223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap996205b2-4c, col_values=(('tag', 13),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:30.567854 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap996205b2-4c, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:30.568429 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap996205b2-4c, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:30.569044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 01:14:30.570632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap996205b2-4c, col_values=(('other_config', {'net_uuid': 'ca88993b-9210-4173-b062-c40cdf9e1da6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '150', 'tag': '13'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:30.571575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 01:14:30.575331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade57af,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 33}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:30.576134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:530 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 11 devices currently available. Time elapsed: 0.014 Sep 04 01:14:30.577227 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Refreshing firewall for 1 devices {{(pid=107812) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 04 01:14:30.577752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Refresh firewall rules Sep 04 01:14:30.579695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information for ports dict_keys([]) {{(pid=107812) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 04 01:14:30.580050 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information {{(pid=107812) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 04 01:14:30.584167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 2 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:14:30.662079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[7325417b-2e9f-4832-9eec-6f788eb6de0f]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:14:30.663085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:530 - agent port security group processed in 0.101 Sep 04 01:14:30.664015 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for 996205b2-4ccc-4913-8458-2e4f1e0e6687 to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 01:14:30.719373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-a78afa89-e74c-4991-b24e-4d9bfe5db65c None None] Resource Port 491c36f8-0074-4f7c-870c-6d117c1f71b6 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=491c36f8-0074-4f7c-870c-6d117c1f71b6,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=491c36f8-0074-4f7c-870c-6d117c1f71b6,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=491c36f8-0074-4f7c-870c-6d117c1f71b6,segment=NetworkSegment(c26850af-ca47-4ea8-9a33-a34f3381800e),segment_id=c26850af-ca47-4ea8-9a33-a34f3381800e)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:14:30.720574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-a78afa89-e74c-4991-b24e-4d9bfe5db65c None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (491c36f8-0074-4f7c-870c-6d117c1f71b6), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:30.885867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Configuration for devices up ['996205b2-4ccc-4913-8458-2e4f1e0e6687'] and devices down [] completed. Sep 04 01:14:30.886194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:530 - ports processed. Elapsed:0.344 Sep 04 01:14:30.886533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:530 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.344 Sep 04 01:14:31.330574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-cf1e1ee5-1574-4dd4-a770-b30e46b43428 admin admin] Received resource Port update without any changes: c73d8972-0881-4e30-8303-b09f2c82f2f0 {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:181}} Sep 04 01:14:31.504704 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["18b26b27-6de0-43ac-a74e-a5200267d668","insert","qg-491c36f8-00",["set",[]],["map",[["attached-mac","fa:16:3e:6d:92:3b"],["iface-id","491c36f8-0074-4f7c-870c-6d117c1f71b6"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:14:31.532739 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["18b26b27-6de0-43ac-a74e-a5200267d668","old",null,["set",[]],null],["","new","qg-491c36f8-00",34,["map",[["attached-mac","fa:16:3e:6d:92:3b"],["iface-id","491c36f8-0074-4f7c-870c-6d117c1f71b6"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:14:32.543350 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:531 started Sep 04 01:14:32.545961 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade57b1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=938000000,duration_sec=1081,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:32.546565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:14:32.547019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:531 - starting polling. Elapsed:0.004 Sep 04 01:14:32.548966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:32.551979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:531 - port information retrieved. Elapsed:0.009 Sep 04 01:14:32.552316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Starting to process devices in:{'current': {'3fa24970-97a7-4f46-ac55-0b24323fa402', '82064230-2100-4279-b030-003ad6dab6f1', '5f5b2b5c-f8bd-4ca8-94f2-f4d5e3a6444d', 'cd34646e-9957-4ab9-b15e-f0afcfd59c3b', '89aa06b4-bbf1-40c2-bb48-500c3aecdf48', 'e7120691-3bea-4fb5-9cd0-62e18c24380d', '491c36f8-0074-4f7c-870c-6d117c1f71b6', '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', '996205b2-4ccc-4913-8458-2e4f1e0e6687', '7f8c6aaa-73de-4cf1-a59c-a00c8f32c2d8', '7f2856e4-8bb1-4647-8890-edd403bce7d0', 'ca102ce7-433c-4029-aabf-33d944165ff1'}, 'added': {'491c36f8-0074-4f7c-870c-6d117c1f71b6'}, 'removed': set(), 'updated': {'491c36f8-0074-4f7c-870c-6d117c1f71b6'}, 're_added': set()} {{(pid=107812) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 04 01:14:32.552899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': '491c36f8-0074-4f7c-870c-6d117c1f71b6', 'device_id': '6dabf8dd-965b-4215-badb-62721cb59027', 'network_id': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'port_id': '491c36f8-0074-4f7c-870c-6d117c1f71b6', 'mac_address': 'fa:16:3e:6d:92:3b', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '2b17f894-c374-4207-90ad-14f794c86627', 'ip_address': '172.37.7.33'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 01:14:32.555226 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: 491c36f8-0074-4f7c-870c-6d117c1f71b6 {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:14:32.555546 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 491c36f8-0074-4f7c-870c-6d117c1f71b6 updated. Details: {'device': '491c36f8-0074-4f7c-870c-6d117c1f71b6', 'device_id': '6dabf8dd-965b-4215-badb-62721cb59027', 'network_id': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'port_id': '491c36f8-0074-4f7c-870c-6d117c1f71b6', 'mac_address': 'fa:16:3e:6d:92:3b', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '2b17f894-c374-4207-90ad-14f794c86627', 'ip_address': '172.37.7.33'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 04 01:14:32.556471 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-491c36f8-00, col_values=(('tag', 2),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:32.556906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-491c36f8-00, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:32.557336 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-491c36f8-00, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:32.562907 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-491c36f8-00, col_values=(('other_config', {'net_uuid': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:32.569465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade57b3,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 34}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:32.569809 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:531 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 12 devices currently available. Time elapsed: 0.017 Sep 04 01:14:32.570174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Preparing device filters for 1 new devices {{(pid=107812) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 04 01:14:32.570465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Preparing filters for devices {'491c36f8-0074-4f7c-870c-6d117c1f71b6'} Sep 04 01:14:32.571618 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information for ports dict_keys([]) {{(pid=107812) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 04 01:14:32.572151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information {{(pid=107812) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 04 01:14:32.580026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 2 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:14:32.618002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1475a7-9e9a-4790-ba6b-237a284ab6d0]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:14:32.618637 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:531 - agent port security group processed in 0.066 Sep 04 01:14:32.619616 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for 491c36f8-0074-4f7c-870c-6d117c1f71b6 to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 01:14:32.941324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Configuration for devices up ['491c36f8-0074-4f7c-870c-6d117c1f71b6'] and devices down [] completed. Sep 04 01:14:32.944979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:531 - ports processed. Elapsed:0.399 Sep 04 01:14:32.944979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:531 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.399 Sep 04 01:14:33.005548 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Resource Port 491c36f8-0074-4f7c-870c-6d117c1f71b6 updated (revision_number 3->4). Old fields: {'status': 'DOWN', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=491c36f8-0074-4f7c-870c-6d117c1f71b6,segment=NetworkSegment(c26850af-ca47-4ea8-9a33-a34f3381800e),segment_id=c26850af-ca47-4ea8-9a33-a34f3381800e)]} New fields: {'status': 'ACTIVE', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=491c36f8-0074-4f7c-870c-6d117c1f71b6,segment=NetworkSegment(c26850af-ca47-4ea8-9a33-a34f3381800e),segment_id=c26850af-ca47-4ea8-9a33-a34f3381800e)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:14:33.006276 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (491c36f8-0074-4f7c-870c-6d117c1f71b6), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:33.338972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-995d4ba3-dbc8-4e98-8d4c-de2903825800 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:14:33Z,description='Default security group',id=d4c8d9f7-49b7-4890-a7c9-8be978bb8b89,is_default=True,name='default',project_id='fa1ba3942811492fb9ef388575baa4e2',revision_number=1,rules=[SecurityGroupRule(8a6303a4-02b9-43cd-8546-7abd98c8baf2),SecurityGroupRule(8be93b85-f75d-4090-a333-58f88072f8d6),SecurityGroupRule(e0021c33-6af7-4658-bc90-0fa5317382e3),SecurityGroupRule(f5442e18-9b79-43aa-b293-2ec77fdf6a5b)],shared=False,stateful=True,updated_at=2022-09-04T01:14:33Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:33.339429 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-995d4ba3-dbc8-4e98-8d4c-de2903825800 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (d4c8d9f7-49b7-4890-a7c9-8be978bb8b89), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:33.340333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-995d4ba3-dbc8-4e98-8d4c-de2903825800 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:14:33Z,description=,direction='ingress',ethertype='IPv4',id=8a6303a4-02b9-43cd-8546-7abd98c8baf2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fa1ba3942811492fb9ef388575baa4e2',protocol=,remote_address_group_id=,remote_group_id=d4c8d9f7-49b7-4890-a7c9-8be978bb8b89,remote_ip_prefix=,revision_number=0,security_group_id=d4c8d9f7-49b7-4890-a7c9-8be978bb8b89,updated_at=2022-09-04T01:14:33Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:33.340826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-995d4ba3-dbc8-4e98-8d4c-de2903825800 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (8a6303a4-02b9-43cd-8546-7abd98c8baf2), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:33.341414 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-995d4ba3-dbc8-4e98-8d4c-de2903825800 admin admin] Security group rule updated ['d4c8d9f7-49b7-4890-a7c9-8be978bb8b89'] Sep 04 01:14:33.342301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-995d4ba3-dbc8-4e98-8d4c-de2903825800 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:14:33Z,description=,direction='ingress',ethertype='IPv6',id=8be93b85-f75d-4090-a333-58f88072f8d6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fa1ba3942811492fb9ef388575baa4e2',protocol=,remote_address_group_id=,remote_group_id=d4c8d9f7-49b7-4890-a7c9-8be978bb8b89,remote_ip_prefix=,revision_number=0,security_group_id=d4c8d9f7-49b7-4890-a7c9-8be978bb8b89,updated_at=2022-09-04T01:14:33Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:33.343239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-995d4ba3-dbc8-4e98-8d4c-de2903825800 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (8be93b85-f75d-4090-a333-58f88072f8d6), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:33.343804 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-995d4ba3-dbc8-4e98-8d4c-de2903825800 admin admin] Security group rule updated ['d4c8d9f7-49b7-4890-a7c9-8be978bb8b89'] Sep 04 01:14:33.344728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-995d4ba3-dbc8-4e98-8d4c-de2903825800 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:14:33Z,description=,direction='egress',ethertype='IPv4',id=e0021c33-6af7-4658-bc90-0fa5317382e3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fa1ba3942811492fb9ef388575baa4e2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=d4c8d9f7-49b7-4890-a7c9-8be978bb8b89,updated_at=2022-09-04T01:14:33Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:33.345114 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-995d4ba3-dbc8-4e98-8d4c-de2903825800 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (e0021c33-6af7-4658-bc90-0fa5317382e3), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:33.345438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-995d4ba3-dbc8-4e98-8d4c-de2903825800 admin admin] Security group rule updated ['d4c8d9f7-49b7-4890-a7c9-8be978bb8b89'] Sep 04 01:14:33.346130 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-995d4ba3-dbc8-4e98-8d4c-de2903825800 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:14:33Z,description=,direction='egress',ethertype='IPv6',id=f5442e18-9b79-43aa-b293-2ec77fdf6a5b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fa1ba3942811492fb9ef388575baa4e2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=d4c8d9f7-49b7-4890-a7c9-8be978bb8b89,updated_at=2022-09-04T01:14:33Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:33.350435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-995d4ba3-dbc8-4e98-8d4c-de2903825800 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (f5442e18-9b79-43aa-b293-2ec77fdf6a5b), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:33.351083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-995d4ba3-dbc8-4e98-8d4c-de2903825800 admin admin] Security group rule updated ['d4c8d9f7-49b7-4890-a7c9-8be978bb8b89'] Sep 04 01:14:33.689644 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-995d4ba3-dbc8-4e98-8d4c-de2903825800 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-04T01:14:33Z,description='',dns_domain=None,id=41b67d38-e689-45bb-a406-6607a99ed49b,mtu=1500,name='tempest-TestVolumeBootPattern-1320443576-network',project_id='fa1ba3942811492fb9ef388575baa4e2',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(41b67d38-e689-45bb-a406-6607a99ed49b),segments=[NetworkSegment(746951e7-0bc8-4b20-aeb2-4159b099caca)],shared=False,status='ACTIVE',updated_at=2022-09-04T01:14:33Z,vlan_transparent=) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:33.690741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-995d4ba3-dbc8-4e98-8d4c-de2903825800 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533'] for Network (41b67d38-e689-45bb-a406-6607a99ed49b), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:33.866301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager [None req-995d4ba3-dbc8-4e98-8d4c-de2903825800 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 41b67d38-e689-45bb-a406-6607a99ed49b with segmentation id not found. Sep 04 01:14:33.866301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 04 01:14:33.866301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 04 01:14:33.866301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 04 01:14:33.866301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 04 01:14:33.866301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 04 01:14:33.866301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 04 01:14:33.866301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 04 01:14:33.866301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 04 01:14:33.866301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 04 01:14:33.866301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 04 01:14:33.866301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 04 01:14:33.866301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 04 01:14:33.867448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 04 01:14:33.867448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 04 01:14:33.867448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 04 01:14:33.867448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 41b67d38-e689-45bb-a406-6607a99ed49b with segmentation id not found. Sep 04 01:14:33.867448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager Sep 04 01:14:34.400660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-60bac440-0eb0-491f-bc83-d5ec73893caa None None] Resource Port c73d8972-0881-4e30-8303-b09f2c82f2f0 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=c73d8972-0881-4e30-8303-b09f2c82f2f0,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=c73d8972-0881-4e30-8303-b09f2c82f2f0,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:14:34.401144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-60bac440-0eb0-491f-bc83-d5ec73893caa None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (c73d8972-0881-4e30-8303-b09f2c82f2f0), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:34.497791 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-5ffc998c-37da-46b5-9f6d-db1accbee21f admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(b94aec06-6c38-469a-a49c-9e2cfd581f24)],cidr=172.20.0.0/28,created_at=2022-09-04T01:14:33Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=223df0be-5574-4032-ab9c-4edcc292cdff,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-TestVolumeBootPattern-1320443576-subnet',network_id=41b67d38-e689-45bb-a406-6607a99ed49b,project_id='fa1ba3942811492fb9ef388575baa4e2',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-04T01:14:33Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:34.498419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-5ffc998c-37da-46b5-9f6d-db1accbee21f admin admin] Publish callbacks [] for Subnet (223df0be-5574-4032-ab9c-4edcc292cdff), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:34.544492 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:532 started Sep 04 01:14:34.547805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade57b5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=939000000,duration_sec=1083,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:34.548439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:14:34.549333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:532 - starting polling. Elapsed:0.005 Sep 04 01:14:34.551138 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:34.553306 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:532 - port information retrieved. Elapsed:0.009 Sep 04 01:14:34.553642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Starting to process devices in:{'current': {'3fa24970-97a7-4f46-ac55-0b24323fa402', '82064230-2100-4279-b030-003ad6dab6f1', '5f5b2b5c-f8bd-4ca8-94f2-f4d5e3a6444d', 'cd34646e-9957-4ab9-b15e-f0afcfd59c3b', '89aa06b4-bbf1-40c2-bb48-500c3aecdf48', 'e7120691-3bea-4fb5-9cd0-62e18c24380d', '491c36f8-0074-4f7c-870c-6d117c1f71b6', '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', '996205b2-4ccc-4913-8458-2e4f1e0e6687', '7f8c6aaa-73de-4cf1-a59c-a00c8f32c2d8', '7f2856e4-8bb1-4647-8890-edd403bce7d0', 'ca102ce7-433c-4029-aabf-33d944165ff1'}, 'added': set(), 'removed': set(), 'updated': {'491c36f8-0074-4f7c-870c-6d117c1f71b6'}, 're_added': set()} {{(pid=107812) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 04 01:14:34.554227 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': '491c36f8-0074-4f7c-870c-6d117c1f71b6', 'device_id': '6dabf8dd-965b-4215-badb-62721cb59027', 'network_id': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'port_id': '491c36f8-0074-4f7c-870c-6d117c1f71b6', 'mac_address': 'fa:16:3e:6d:92:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '2b17f894-c374-4207-90ad-14f794c86627', 'ip_address': '172.37.7.33'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 01:14:34.566931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: 491c36f8-0074-4f7c-870c-6d117c1f71b6 {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:14:34.567612 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 491c36f8-0074-4f7c-870c-6d117c1f71b6 updated. Details: {'device': '491c36f8-0074-4f7c-870c-6d117c1f71b6', 'device_id': '6dabf8dd-965b-4215-badb-62721cb59027', 'network_id': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'port_id': '491c36f8-0074-4f7c-870c-6d117c1f71b6', 'mac_address': 'fa:16:3e:6d:92:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '2b17f894-c374-4207-90ad-14f794c86627', 'ip_address': '172.37.7.33'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 04 01:14:34.568959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-491c36f8-00, col_values=(('tag', 2),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:34.569842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-491c36f8-00, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:34.570479 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-491c36f8-00, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:34.571137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 01:14:34.573091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-491c36f8-00, col_values=(('other_config', {'net_uuid': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:34.573978 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 01:14:34.579750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade57b7,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 34}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:34.580381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:532 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 12 devices currently available. Time elapsed: 0.026 Sep 04 01:14:34.580985 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Refreshing firewall for 1 devices {{(pid=107812) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 04 01:14:34.581502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Refresh firewall rules Sep 04 01:14:34.582847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information for ports dict_keys([]) {{(pid=107812) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 04 01:14:34.583337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information {{(pid=107812) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 04 01:14:34.586747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 2 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:14:34.630908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49d5a26-6611-4f15-9dbb-7f035af494c9]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:14:34.631932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:532 - agent port security group processed in 0.078 Sep 04 01:14:34.632915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for 491c36f8-0074-4f7c-870c-6d117c1f71b6 to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 01:14:34.846527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-60bac440-0eb0-491f-bc83-d5ec73893caa None None] Resource Port c73d8972-0881-4e30-8303-b09f2c82f2f0 updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=c73d8972-0881-4e30-8303-b09f2c82f2f0,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=c73d8972-0881-4e30-8303-b09f2c82f2f0,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=c73d8972-0881-4e30-8303-b09f2c82f2f0,segment=NetworkSegment(ec3b99f9-cd00-455f-aba9-a56f7e7f2980),segment_id=ec3b99f9-cd00-455f-aba9-a56f7e7f2980)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:14:34.847254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-60bac440-0eb0-491f-bc83-d5ec73893caa None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (c73d8972-0881-4e30-8303-b09f2c82f2f0), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:35.269466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Configuration for devices up ['491c36f8-0074-4f7c-870c-6d117c1f71b6'] and devices down [] completed. Sep 04 01:14:35.271447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:532 - ports processed. Elapsed:0.727 Sep 04 01:14:35.271994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:532 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.728 Sep 04 01:14:35.701347 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["fdd9c160-e5e1-443f-997a-3c8dd4ae619f","insert","qr-c73d8972-08",["set",[]],["map",[["attached-mac","fa:16:3e:b7:43:f1"],["iface-id","c73d8972-0881-4e30-8303-b09f2c82f2f0"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:14:35.715266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["fdd9c160-e5e1-443f-997a-3c8dd4ae619f","old",null,["set",[]],null],["","new","qr-c73d8972-08",35,["map",[["attached-mac","fa:16:3e:b7:43:f1"],["iface-id","c73d8972-0881-4e30-8303-b09f2c82f2f0"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:14:36.026659 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-f824a001-3458-4cdb-a95c-cb28dbd8ad08 None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:14:35Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-41b67d38-e689-45bb-a406-6607a99ed49b',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=20940f6e-c5ec-497b-b144-a180350e4857,mac_address=fa:16:3e:bc:27:a2,name='',network_id=41b67d38-e689-45bb-a406-6607a99ed49b,numa_affinity_policy=,project_id='fa1ba3942811492fb9ef388575baa4e2',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(20940f6e-c5ec-497b-b144-a180350e4857),security_group_ids=set([]),status='DOWN',updated_at=2022-09-04T01:14:35Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:36.027331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-f824a001-3458-4cdb-a95c-cb28dbd8ad08 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (20940f6e-c5ec-497b-b144-a180350e4857), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:36.432461 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-f824a001-3458-4cdb-a95c-cb28dbd8ad08 None None] Resource Port 20940f6e-c5ec-497b-b144-a180350e4857 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=20940f6e-c5ec-497b-b144-a180350e4857,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=20940f6e-c5ec-497b-b144-a180350e4857,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=20940f6e-c5ec-497b-b144-a180350e4857,segment=NetworkSegment(746951e7-0bc8-4b20-aeb2-4159b099caca),segment_id=746951e7-0bc8-4b20-aeb2-4159b099caca)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:14:36.432874 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-f824a001-3458-4cdb-a95c-cb28dbd8ad08 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (20940f6e-c5ec-497b-b144-a180350e4857), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:36.461565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-2560a61f-4812-4c44-9c61-a62142dbbe2e admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:14:35Z,data_plane_status=None,description='',device_id='a70adf6d-b889-4681-acc7-04ce1b1c76a6',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=2c3ac556-7316-478e-a2cf-0863e3b01f18,mac_address=fa:16:3e:5b:36:9e,name='',network_id=e8e0564a-d5c9-4fe0-b2d4-538f45096708,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(2c3ac556-7316-478e-a2cf-0863e3b01f18),security_group_ids=set([]),status='DOWN',updated_at=2022-09-04T01:14:35Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:36.463272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-2560a61f-4812-4c44-9c61-a62142dbbe2e admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (2c3ac556-7316-478e-a2cf-0863e3b01f18), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:36.544881 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:533 started Sep 04 01:14:36.548199 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade57b9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=939000000,duration_sec=1085,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:36.548797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:14:36.549388 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:533 - starting polling. Elapsed:0.005 Sep 04 01:14:36.557965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:36.561337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:533 - port information retrieved. Elapsed:0.017 Sep 04 01:14:36.561684 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Starting to process devices in:{'current': {'3fa24970-97a7-4f46-ac55-0b24323fa402', '82064230-2100-4279-b030-003ad6dab6f1', '5f5b2b5c-f8bd-4ca8-94f2-f4d5e3a6444d', 'cd34646e-9957-4ab9-b15e-f0afcfd59c3b', '89aa06b4-bbf1-40c2-bb48-500c3aecdf48', 'e7120691-3bea-4fb5-9cd0-62e18c24380d', '491c36f8-0074-4f7c-870c-6d117c1f71b6', '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', '996205b2-4ccc-4913-8458-2e4f1e0e6687', '7f8c6aaa-73de-4cf1-a59c-a00c8f32c2d8', 'c73d8972-0881-4e30-8303-b09f2c82f2f0', '7f2856e4-8bb1-4647-8890-edd403bce7d0', 'ca102ce7-433c-4029-aabf-33d944165ff1'}, 'added': {'c73d8972-0881-4e30-8303-b09f2c82f2f0'}, 'removed': set(), 'updated': {'c73d8972-0881-4e30-8303-b09f2c82f2f0'}, 're_added': set()} {{(pid=107812) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 04 01:14:36.562256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': 'c73d8972-0881-4e30-8303-b09f2c82f2f0', 'device_id': '6dabf8dd-965b-4215-badb-62721cb59027', 'network_id': 'ca88993b-9210-4173-b062-c40cdf9e1da6', 'port_id': 'c73d8972-0881-4e30-8303-b09f2c82f2f0', 'mac_address': 'fa:16:3e:b7:43:f1', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 150, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '53b46299-8023-4a0f-bdf3-86b9a7286814', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 01:14:36.565976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: c73d8972-0881-4e30-8303-b09f2c82f2f0 {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:14:36.567956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port c73d8972-0881-4e30-8303-b09f2c82f2f0 updated. Details: {'device': 'c73d8972-0881-4e30-8303-b09f2c82f2f0', 'device_id': '6dabf8dd-965b-4215-badb-62721cb59027', 'network_id': 'ca88993b-9210-4173-b062-c40cdf9e1da6', 'port_id': 'c73d8972-0881-4e30-8303-b09f2c82f2f0', 'mac_address': 'fa:16:3e:b7:43:f1', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 150, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '53b46299-8023-4a0f-bdf3-86b9a7286814', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 13} Sep 04 01:14:36.572586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-c73d8972-08, col_values=(('tag', 13),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:36.572586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-c73d8972-08, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:36.572586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-c73d8972-08, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:36.582229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-c73d8972-08, col_values=(('other_config', {'net_uuid': 'ca88993b-9210-4173-b062-c40cdf9e1da6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '13', 'segmentation_id': '150'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:36.597698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade57bb,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 35}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:36.598429 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:533 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 13 devices currently available. Time elapsed: 0.036 Sep 04 01:14:36.599003 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Preparing device filters for 1 new devices {{(pid=107812) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 04 01:14:36.599510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Preparing filters for devices {'c73d8972-0881-4e30-8303-b09f2c82f2f0'} Sep 04 01:14:36.601039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information for ports dict_keys([]) {{(pid=107812) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 04 01:14:36.601539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information {{(pid=107812) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 04 01:14:36.615187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["547531f3-dc28-448d-89ce-0f24e3bdaf1b","insert","tap20940f6e-c5",["set",[]],["map",[["attached-mac","fa:16:3e:bc:27:a2"],["iface-id","20940f6e-c5ec-497b-b144-a180350e4857"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:14:36.616496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 2 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:14:36.642020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["547531f3-dc28-448d-89ce-0f24e3bdaf1b","old",null,["set",[]],null],["","new","tap20940f6e-c5",36,["map",[["attached-mac","fa:16:3e:bc:27:a2"],["iface-id","20940f6e-c5ec-497b-b144-a180350e4857"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:14:36.681323 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[54168fd8-c176-4994-bb10-7c8a7ee27b68]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:14:36.682034 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:533 - agent port security group processed in 0.120 Sep 04 01:14:36.682912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for c73d8972-0881-4e30-8303-b09f2c82f2f0 to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 01:14:36.989310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Configuration for devices up ['c73d8972-0881-4e30-8303-b09f2c82f2f0'] and devices down [] completed. Sep 04 01:14:36.990401 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:533 - ports processed. Elapsed:0.446 Sep 04 01:14:36.991001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:533 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.446 Sep 04 01:14:37.044285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Resource Port c73d8972-0881-4e30-8303-b09f2c82f2f0 updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:14:37.045516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (c73d8972-0881-4e30-8303-b09f2c82f2f0), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:37.771602 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-f4bb24ed-d8b9-4c72-9f30-3b326c5f9827 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:14:37Z,description='Default security group',id=a375cf13-9a80-4fe8-bb02-c64c81019444,is_default=True,name='default',project_id='b5bfefa807364899ae84d6ae0acf6c89',revision_number=1,rules=[SecurityGroupRule(2db4aef9-8a54-46fe-9f5e-a161f01caa18),SecurityGroupRule(4f1ff3fd-0dd6-4a8b-b5d3-cf4a291e1b03),SecurityGroupRule(aa543e94-5982-48fc-a63a-c95406f0fe63),SecurityGroupRule(f5fb9edf-221b-4e7d-a9d6-85acb79bfbd7)],shared=False,stateful=True,updated_at=2022-09-04T01:14:37Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:37.771980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-f4bb24ed-d8b9-4c72-9f30-3b326c5f9827 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (a375cf13-9a80-4fe8-bb02-c64c81019444), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:37.772602 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-f4bb24ed-d8b9-4c72-9f30-3b326c5f9827 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:14:37Z,description=,direction='egress',ethertype='IPv4',id=2db4aef9-8a54-46fe-9f5e-a161f01caa18,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b5bfefa807364899ae84d6ae0acf6c89',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=a375cf13-9a80-4fe8-bb02-c64c81019444,updated_at=2022-09-04T01:14:37Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:37.773148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-f4bb24ed-d8b9-4c72-9f30-3b326c5f9827 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (2db4aef9-8a54-46fe-9f5e-a161f01caa18), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:37.773492 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-f4bb24ed-d8b9-4c72-9f30-3b326c5f9827 admin admin] Security group rule updated ['a375cf13-9a80-4fe8-bb02-c64c81019444'] Sep 04 01:14:37.774924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-f4bb24ed-d8b9-4c72-9f30-3b326c5f9827 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:14:37Z,description=,direction='ingress',ethertype='IPv4',id=4f1ff3fd-0dd6-4a8b-b5d3-cf4a291e1b03,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b5bfefa807364899ae84d6ae0acf6c89',protocol=,remote_address_group_id=,remote_group_id=a375cf13-9a80-4fe8-bb02-c64c81019444,remote_ip_prefix=,revision_number=0,security_group_id=a375cf13-9a80-4fe8-bb02-c64c81019444,updated_at=2022-09-04T01:14:37Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:37.774924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-f4bb24ed-d8b9-4c72-9f30-3b326c5f9827 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (4f1ff3fd-0dd6-4a8b-b5d3-cf4a291e1b03), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:37.774924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-f4bb24ed-d8b9-4c72-9f30-3b326c5f9827 admin admin] Security group rule updated ['a375cf13-9a80-4fe8-bb02-c64c81019444'] Sep 04 01:14:37.775554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-f4bb24ed-d8b9-4c72-9f30-3b326c5f9827 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:14:37Z,description=,direction='egress',ethertype='IPv6',id=aa543e94-5982-48fc-a63a-c95406f0fe63,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b5bfefa807364899ae84d6ae0acf6c89',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=a375cf13-9a80-4fe8-bb02-c64c81019444,updated_at=2022-09-04T01:14:37Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:37.775909 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-f4bb24ed-d8b9-4c72-9f30-3b326c5f9827 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (aa543e94-5982-48fc-a63a-c95406f0fe63), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:37.776235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-f4bb24ed-d8b9-4c72-9f30-3b326c5f9827 admin admin] Security group rule updated ['a375cf13-9a80-4fe8-bb02-c64c81019444'] Sep 04 01:14:37.776934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-f4bb24ed-d8b9-4c72-9f30-3b326c5f9827 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:14:37Z,description=,direction='ingress',ethertype='IPv6',id=f5fb9edf-221b-4e7d-a9d6-85acb79bfbd7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b5bfefa807364899ae84d6ae0acf6c89',protocol=,remote_address_group_id=,remote_group_id=a375cf13-9a80-4fe8-bb02-c64c81019444,remote_ip_prefix=,revision_number=0,security_group_id=a375cf13-9a80-4fe8-bb02-c64c81019444,updated_at=2022-09-04T01:14:37Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:37.777314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-f4bb24ed-d8b9-4c72-9f30-3b326c5f9827 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (f5fb9edf-221b-4e7d-a9d6-85acb79bfbd7), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:37.777638 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-f4bb24ed-d8b9-4c72-9f30-3b326c5f9827 admin admin] Security group rule updated ['a375cf13-9a80-4fe8-bb02-c64c81019444'] Sep 04 01:14:38.164714 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-0164a6e0-dd9d-45ec-b0bd-4f890fc72511 None None] Resource Port 20940f6e-c5ec-497b-b144-a180350e4857 updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:14:38.165366 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-0164a6e0-dd9d-45ec-b0bd-4f890fc72511 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (20940f6e-c5ec-497b-b144-a180350e4857), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:38.275910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-317036a6-896b-466b-965a-0be555572a35 admin admin] Resource SecurityGroup deleted: a375cf13-9a80-4fe8-bb02-c64c81019444 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:38.276405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-317036a6-896b-466b-965a-0be555572a35 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (a375cf13-9a80-4fe8-bb02-c64c81019444), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:38.276963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-317036a6-896b-466b-965a-0be555572a35 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('a375cf13-9a80-4fe8-bb02-c64c81019444',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:14:38.303165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-317036a6-896b-466b-965a-0be555572a35 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('a375cf13-9a80-4fe8-bb02-c64c81019444',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:14:38.303603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-317036a6-896b-466b-965a-0be555572a35 admin admin] Resource SecurityGroupRule deleted: 2db4aef9-8a54-46fe-9f5e-a161f01caa18 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:38.303974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-317036a6-896b-466b-965a-0be555572a35 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (2db4aef9-8a54-46fe-9f5e-a161f01caa18), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:38.304321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-317036a6-896b-466b-965a-0be555572a35 admin admin] Security group rule updated ['a375cf13-9a80-4fe8-bb02-c64c81019444'] Sep 04 01:14:38.304734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-317036a6-896b-466b-965a-0be555572a35 admin admin] Resource SecurityGroupRule deleted: 4f1ff3fd-0dd6-4a8b-b5d3-cf4a291e1b03 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:38.305297 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-317036a6-896b-466b-965a-0be555572a35 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (4f1ff3fd-0dd6-4a8b-b5d3-cf4a291e1b03), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:38.305614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-317036a6-896b-466b-965a-0be555572a35 admin admin] Security group rule updated ['a375cf13-9a80-4fe8-bb02-c64c81019444'] Sep 04 01:14:38.307027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-317036a6-896b-466b-965a-0be555572a35 admin admin] Resource SecurityGroupRule deleted: aa543e94-5982-48fc-a63a-c95406f0fe63 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:38.307377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-317036a6-896b-466b-965a-0be555572a35 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (aa543e94-5982-48fc-a63a-c95406f0fe63), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:38.307697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-317036a6-896b-466b-965a-0be555572a35 admin admin] Security group rule updated ['a375cf13-9a80-4fe8-bb02-c64c81019444'] Sep 04 01:14:38.308113 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-317036a6-896b-466b-965a-0be555572a35 admin admin] Resource SecurityGroupRule deleted: f5fb9edf-221b-4e7d-a9d6-85acb79bfbd7 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:38.308449 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-317036a6-896b-466b-965a-0be555572a35 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (f5fb9edf-221b-4e7d-a9d6-85acb79bfbd7), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:38.308760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-317036a6-896b-466b-965a-0be555572a35 admin admin] Security group rule updated ['a375cf13-9a80-4fe8-bb02-c64c81019444'] Sep 04 01:14:38.546024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:534 started Sep 04 01:14:38.548914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade57bd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=940000000,duration_sec=1087,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:38.549781 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:14:38.550720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:534 - starting polling. Elapsed:0.005 Sep 04 01:14:38.552950 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:38.556073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:534 - port information retrieved. Elapsed:0.010 Sep 04 01:14:38.556507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Starting to process devices in:{'current': {'3fa24970-97a7-4f46-ac55-0b24323fa402', '82064230-2100-4279-b030-003ad6dab6f1', '5f5b2b5c-f8bd-4ca8-94f2-f4d5e3a6444d', 'cd34646e-9957-4ab9-b15e-f0afcfd59c3b', '89aa06b4-bbf1-40c2-bb48-500c3aecdf48', 'e7120691-3bea-4fb5-9cd0-62e18c24380d', '491c36f8-0074-4f7c-870c-6d117c1f71b6', '20940f6e-c5ec-497b-b144-a180350e4857', '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', '996205b2-4ccc-4913-8458-2e4f1e0e6687', '7f8c6aaa-73de-4cf1-a59c-a00c8f32c2d8', 'c73d8972-0881-4e30-8303-b09f2c82f2f0', '7f2856e4-8bb1-4647-8890-edd403bce7d0', 'ca102ce7-433c-4029-aabf-33d944165ff1'}, 'added': {'20940f6e-c5ec-497b-b144-a180350e4857'}, 'removed': set(), 'updated': {'c73d8972-0881-4e30-8303-b09f2c82f2f0', '20940f6e-c5ec-497b-b144-a180350e4857'}, 're_added': set()} {{(pid=107812) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 04 01:14:38.557990 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': 'c73d8972-0881-4e30-8303-b09f2c82f2f0', 'device_id': '6dabf8dd-965b-4215-badb-62721cb59027', 'network_id': 'ca88993b-9210-4173-b062-c40cdf9e1da6', 'port_id': 'c73d8972-0881-4e30-8303-b09f2c82f2f0', 'mac_address': 'fa:16:3e:b7:43:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 150, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '53b46299-8023-4a0f-bdf3-86b9a7286814', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 01:14:38.558678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': '20940f6e-c5ec-497b-b144-a180350e4857', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-41b67d38-e689-45bb-a406-6607a99ed49b', 'network_id': '41b67d38-e689-45bb-a406-6607a99ed49b', 'port_id': '20940f6e-c5ec-497b-b144-a180350e4857', 'mac_address': 'fa:16:3e:bc:27:a2', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 199, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '223df0be-5574-4032-ab9c-4edcc292cdff', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 01:14:38.562949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: c73d8972-0881-4e30-8303-b09f2c82f2f0 {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:14:38.563514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port c73d8972-0881-4e30-8303-b09f2c82f2f0 updated. Details: {'device': 'c73d8972-0881-4e30-8303-b09f2c82f2f0', 'device_id': '6dabf8dd-965b-4215-badb-62721cb59027', 'network_id': 'ca88993b-9210-4173-b062-c40cdf9e1da6', 'port_id': 'c73d8972-0881-4e30-8303-b09f2c82f2f0', 'mac_address': 'fa:16:3e:b7:43:f1', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 150, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '53b46299-8023-4a0f-bdf3-86b9a7286814', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 13} Sep 04 01:14:38.564962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-c73d8972-08, col_values=(('tag', 13),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:38.565662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-c73d8972-08, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:38.566258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-c73d8972-08, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:38.566903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 01:14:38.568096 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-c73d8972-08, col_values=(('other_config', {'net_uuid': 'ca88993b-9210-4173-b062-c40cdf9e1da6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '150', 'tag': '13'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:38.569360 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 01:14:38.576230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade57bf,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 35}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:38.582422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: 20940f6e-c5ec-497b-b144-a180350e4857 {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:14:38.582422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 20940f6e-c5ec-497b-b144-a180350e4857 updated. Details: {'device': '20940f6e-c5ec-497b-b144-a180350e4857', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-41b67d38-e689-45bb-a406-6607a99ed49b', 'network_id': '41b67d38-e689-45bb-a406-6607a99ed49b', 'port_id': '20940f6e-c5ec-497b-b144-a180350e4857', 'mac_address': 'fa:16:3e:bc:27:a2', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 199, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '223df0be-5574-4032-ab9c-4edcc292cdff', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Sep 04 01:14:38.582422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Assigning 14 as local vlan for net-id=41b67d38-e689-45bb-a406-6607a99ed49b, seg-id=199 Sep 04 01:14:38.582781 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0x1fd38c15,OFPFlowMod(buffer_id=4294967295,command=0,cookie=6561907047025962751,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4295), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4110}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:38.586835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0xeade57c1,OFPFlowMod(buffer_id=4294967295,command=0,cookie=6887031442322345889,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4110)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4295}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:38.588086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap20940f6e-c5, col_values=(('tag', 14),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:38.588689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap20940f6e-c5, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:38.589319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap20940f6e-c5, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:38.600177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap20940f6e-c5, col_values=(('other_config', {'net_uuid': '41b67d38-e689-45bb-a406-6607a99ed49b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '14', 'segmentation_id': '199'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:38.613780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade57c3,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 36}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:38.614420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:534 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 14 devices currently available. Time elapsed: 0.057 Sep 04 01:14:38.615115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Preparing device filters for 1 new devices {{(pid=107812) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 04 01:14:38.615706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Preparing filters for devices {'20940f6e-c5ec-497b-b144-a180350e4857'} Sep 04 01:14:38.617454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information for ports dict_keys([]) {{(pid=107812) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 04 01:14:38.617738 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information {{(pid=107812) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 04 01:14:38.623236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 2 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:14:38.683263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb9da20-810b-4ee0-842e-6bdafc7c59ae]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:14:38.685053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Refreshing firewall for 1 devices {{(pid=107812) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 04 01:14:38.685609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Refresh firewall rules Sep 04 01:14:38.686999 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information for ports dict_keys([]) {{(pid=107812) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 04 01:14:38.687387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information {{(pid=107812) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 04 01:14:38.691145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 2 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:14:38.749672 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c23ecb-a7ff-4f06-97ed-b899ab840e7e]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:14:38.750391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:534 - agent port security group processed in 0.193 Sep 04 01:14:38.751354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for c73d8972-0881-4e30-8303-b09f2c82f2f0 to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 01:14:38.751734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for 20940f6e-c5ec-497b-b144-a180350e4857 to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 01:14:38.933783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b31a282f-e2ea-4b30-98a6-2aaa3f5f676b None None] Resource Port 2c3ac556-7316-478e-a2cf-0863e3b01f18 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=2c3ac556-7316-478e-a2cf-0863e3b01f18,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=2c3ac556-7316-478e-a2cf-0863e3b01f18,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:14:38.936625 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b31a282f-e2ea-4b30-98a6-2aaa3f5f676b None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (2c3ac556-7316-478e-a2cf-0863e3b01f18), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:39.042386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Configuration for devices up ['c73d8972-0881-4e30-8303-b09f2c82f2f0', '20940f6e-c5ec-497b-b144-a180350e4857'] and devices down [] completed. Sep 04 01:14:39.043229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:534 - ports processed. Elapsed:0.497 Sep 04 01:14:39.043706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:534 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 2, 'removed': 0}}. Elapsed:0.498 Sep 04 01:14:39.173547 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b31a282f-e2ea-4b30-98a6-2aaa3f5f676b None None] Resource Port 2c3ac556-7316-478e-a2cf-0863e3b01f18 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=2c3ac556-7316-478e-a2cf-0863e3b01f18,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=2c3ac556-7316-478e-a2cf-0863e3b01f18,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=2c3ac556-7316-478e-a2cf-0863e3b01f18,segment=NetworkSegment(c26850af-ca47-4ea8-9a33-a34f3381800e),segment_id=c26850af-ca47-4ea8-9a33-a34f3381800e)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:14:39.174532 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b31a282f-e2ea-4b30-98a6-2aaa3f5f676b None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (2c3ac556-7316-478e-a2cf-0863e3b01f18), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:39.333679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c8d316f9-7a4d-47f6-b0e1-a7e4c0e3e3a3 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:14:38Z,data_plane_status=None,description='',device_id='a70adf6d-b889-4681-acc7-04ce1b1c76a6',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=4e686822-d1bf-4795-baed-c36577dc9ff3,mac_address=fa:16:3e:85:6a:3d,name='',network_id=41b67d38-e689-45bb-a406-6607a99ed49b,numa_affinity_policy=,project_id='fa1ba3942811492fb9ef388575baa4e2',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(4e686822-d1bf-4795-baed-c36577dc9ff3),security_group_ids=set([]),status='DOWN',updated_at=2022-09-04T01:14:38Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:39.334580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-c8d316f9-7a4d-47f6-b0e1-a7e4c0e3e3a3 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (4e686822-d1bf-4795-baed-c36577dc9ff3), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:39.386071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-3fd40bb2-f0bb-47bd-be88-3584b46debfe admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:14:39Z,description='Default security group',id=619ba220-916d-44a1-9f69-29713bf8fa17,is_default=True,name='default',project_id='136968e58b1b42289f63983c8d7f4927',revision_number=1,rules=[SecurityGroupRule(643ed957-c5db-4a06-8723-9f553b412da4),SecurityGroupRule(b6ed8221-1d67-4b30-a5a8-a38b4eb8572d),SecurityGroupRule(d19f9af3-121c-4cc7-9033-f763b22770e4),SecurityGroupRule(f0a17f10-e777-4614-a243-d3ee43580050)],shared=False,stateful=True,updated_at=2022-09-04T01:14:39Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:39.386738 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-3fd40bb2-f0bb-47bd-be88-3584b46debfe admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (619ba220-916d-44a1-9f69-29713bf8fa17), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:39.387932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-3fd40bb2-f0bb-47bd-be88-3584b46debfe admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:14:39Z,description=,direction='ingress',ethertype='IPv4',id=643ed957-c5db-4a06-8723-9f553b412da4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='136968e58b1b42289f63983c8d7f4927',protocol=,remote_address_group_id=,remote_group_id=619ba220-916d-44a1-9f69-29713bf8fa17,remote_ip_prefix=,revision_number=0,security_group_id=619ba220-916d-44a1-9f69-29713bf8fa17,updated_at=2022-09-04T01:14:39Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:39.388509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-3fd40bb2-f0bb-47bd-be88-3584b46debfe admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (643ed957-c5db-4a06-8723-9f553b412da4), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:39.389669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-3fd40bb2-f0bb-47bd-be88-3584b46debfe admin admin] Security group rule updated ['619ba220-916d-44a1-9f69-29713bf8fa17'] Sep 04 01:14:39.390628 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-3fd40bb2-f0bb-47bd-be88-3584b46debfe admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:14:39Z,description=,direction='egress',ethertype='IPv6',id=b6ed8221-1d67-4b30-a5a8-a38b4eb8572d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='136968e58b1b42289f63983c8d7f4927',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=619ba220-916d-44a1-9f69-29713bf8fa17,updated_at=2022-09-04T01:14:39Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:39.391256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-3fd40bb2-f0bb-47bd-be88-3584b46debfe admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (b6ed8221-1d67-4b30-a5a8-a38b4eb8572d), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:39.391993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-3fd40bb2-f0bb-47bd-be88-3584b46debfe admin admin] Security group rule updated ['619ba220-916d-44a1-9f69-29713bf8fa17'] Sep 04 01:14:39.392965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-3fd40bb2-f0bb-47bd-be88-3584b46debfe admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:14:39Z,description=,direction='ingress',ethertype='IPv6',id=d19f9af3-121c-4cc7-9033-f763b22770e4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='136968e58b1b42289f63983c8d7f4927',protocol=,remote_address_group_id=,remote_group_id=619ba220-916d-44a1-9f69-29713bf8fa17,remote_ip_prefix=,revision_number=0,security_group_id=619ba220-916d-44a1-9f69-29713bf8fa17,updated_at=2022-09-04T01:14:39Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:39.393719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-3fd40bb2-f0bb-47bd-be88-3584b46debfe admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (d19f9af3-121c-4cc7-9033-f763b22770e4), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:39.394270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-3fd40bb2-f0bb-47bd-be88-3584b46debfe admin admin] Security group rule updated ['619ba220-916d-44a1-9f69-29713bf8fa17'] Sep 04 01:14:39.396071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-3fd40bb2-f0bb-47bd-be88-3584b46debfe admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:14:39Z,description=,direction='egress',ethertype='IPv4',id=f0a17f10-e777-4614-a243-d3ee43580050,normalized_cidr=None,port_range_max=,port_range_min=,project_id='136968e58b1b42289f63983c8d7f4927',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=619ba220-916d-44a1-9f69-29713bf8fa17,updated_at=2022-09-04T01:14:39Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:39.396667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-3fd40bb2-f0bb-47bd-be88-3584b46debfe admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (f0a17f10-e777-4614-a243-d3ee43580050), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:39.397546 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-3fd40bb2-f0bb-47bd-be88-3584b46debfe admin admin] Security group rule updated ['619ba220-916d-44a1-9f69-29713bf8fa17'] Sep 04 01:14:39.729647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4e6062e8-6bda-4a6c-887a-290e582f743b admin admin] Resource SecurityGroup deleted: 619ba220-916d-44a1-9f69-29713bf8fa17 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:39.730022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4e6062e8-6bda-4a6c-887a-290e582f743b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (619ba220-916d-44a1-9f69-29713bf8fa17), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:39.730487 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e6062e8-6bda-4a6c-887a-290e582f743b admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('619ba220-916d-44a1-9f69-29713bf8fa17',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:14:39.757763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4e6062e8-6bda-4a6c-887a-290e582f743b admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('619ba220-916d-44a1-9f69-29713bf8fa17',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:14:39.758145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4e6062e8-6bda-4a6c-887a-290e582f743b admin admin] Resource SecurityGroupRule deleted: 643ed957-c5db-4a06-8723-9f553b412da4 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:39.758509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4e6062e8-6bda-4a6c-887a-290e582f743b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (643ed957-c5db-4a06-8723-9f553b412da4), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:39.758836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-4e6062e8-6bda-4a6c-887a-290e582f743b admin admin] Security group rule updated ['619ba220-916d-44a1-9f69-29713bf8fa17'] Sep 04 01:14:39.759268 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4e6062e8-6bda-4a6c-887a-290e582f743b admin admin] Resource SecurityGroupRule deleted: b6ed8221-1d67-4b30-a5a8-a38b4eb8572d {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:39.759610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4e6062e8-6bda-4a6c-887a-290e582f743b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (b6ed8221-1d67-4b30-a5a8-a38b4eb8572d), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:39.760024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-4e6062e8-6bda-4a6c-887a-290e582f743b admin admin] Security group rule updated ['619ba220-916d-44a1-9f69-29713bf8fa17'] Sep 04 01:14:39.760441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4e6062e8-6bda-4a6c-887a-290e582f743b admin admin] Resource SecurityGroupRule deleted: d19f9af3-121c-4cc7-9033-f763b22770e4 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:39.761065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4e6062e8-6bda-4a6c-887a-290e582f743b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (d19f9af3-121c-4cc7-9033-f763b22770e4), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:39.761235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-4e6062e8-6bda-4a6c-887a-290e582f743b admin admin] Security group rule updated ['619ba220-916d-44a1-9f69-29713bf8fa17'] Sep 04 01:14:39.761570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4e6062e8-6bda-4a6c-887a-290e582f743b admin admin] Resource SecurityGroupRule deleted: f0a17f10-e777-4614-a243-d3ee43580050 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:39.761908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4e6062e8-6bda-4a6c-887a-290e582f743b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (f0a17f10-e777-4614-a243-d3ee43580050), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:39.762267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-4e6062e8-6bda-4a6c-887a-290e582f743b admin admin] Security group rule updated ['619ba220-916d-44a1-9f69-29713bf8fa17'] Sep 04 01:14:39.803318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["fbfd7991-8eba-4b0e-a721-4a22f5382690","insert","qg-2c3ac556-73",["set",[]],["map",[["attached-mac","fa:16:3e:5b:36:9e"],["iface-id","2c3ac556-7316-478e-a2cf-0863e3b01f18"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:14:39.821224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["fbfd7991-8eba-4b0e-a721-4a22f5382690","old",null,["set",[]],null],["","new","qg-2c3ac556-73",37,["map",[["attached-mac","fa:16:3e:5b:36:9e"],["iface-id","2c3ac556-7316-478e-a2cf-0863e3b01f18"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:14:40.041483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c8d316f9-7a4d-47f6-b0e1-a7e4c0e3e3a3 admin admin] Received resource Port update without any changes: 4e686822-d1bf-4795-baed-c36577dc9ff3 {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:181}} Sep 04 01:14:40.547030 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:535 started Sep 04 01:14:40.549727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade57c5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=941000000,duration_sec=1089,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:40.550302 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:14:40.550760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:535 - starting polling. Elapsed:0.004 Sep 04 01:14:40.552976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:40.556043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:535 - port information retrieved. Elapsed:0.009 Sep 04 01:14:40.556377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Starting to process devices in:{'current': {'3fa24970-97a7-4f46-ac55-0b24323fa402', '2c3ac556-7316-478e-a2cf-0863e3b01f18', '82064230-2100-4279-b030-003ad6dab6f1', '5f5b2b5c-f8bd-4ca8-94f2-f4d5e3a6444d', 'cd34646e-9957-4ab9-b15e-f0afcfd59c3b', '89aa06b4-bbf1-40c2-bb48-500c3aecdf48', 'e7120691-3bea-4fb5-9cd0-62e18c24380d', '491c36f8-0074-4f7c-870c-6d117c1f71b6', '20940f6e-c5ec-497b-b144-a180350e4857', '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', '996205b2-4ccc-4913-8458-2e4f1e0e6687', '7f8c6aaa-73de-4cf1-a59c-a00c8f32c2d8', 'c73d8972-0881-4e30-8303-b09f2c82f2f0', '7f2856e4-8bb1-4647-8890-edd403bce7d0', 'ca102ce7-433c-4029-aabf-33d944165ff1'}, 'added': {'2c3ac556-7316-478e-a2cf-0863e3b01f18'}, 'removed': set(), 'updated': {'2c3ac556-7316-478e-a2cf-0863e3b01f18'}, 're_added': set()} {{(pid=107812) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 04 01:14:40.556961 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': '2c3ac556-7316-478e-a2cf-0863e3b01f18', 'device_id': 'a70adf6d-b889-4681-acc7-04ce1b1c76a6', 'network_id': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'port_id': '2c3ac556-7316-478e-a2cf-0863e3b01f18', 'mac_address': 'fa:16:3e:5b:36:9e', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '2b17f894-c374-4207-90ad-14f794c86627', 'ip_address': '172.37.7.81'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 01:14:40.560331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: 2c3ac556-7316-478e-a2cf-0863e3b01f18 {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:14:40.560654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 2c3ac556-7316-478e-a2cf-0863e3b01f18 updated. Details: {'device': '2c3ac556-7316-478e-a2cf-0863e3b01f18', 'device_id': 'a70adf6d-b889-4681-acc7-04ce1b1c76a6', 'network_id': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'port_id': '2c3ac556-7316-478e-a2cf-0863e3b01f18', 'mac_address': 'fa:16:3e:5b:36:9e', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '2b17f894-c374-4207-90ad-14f794c86627', 'ip_address': '172.37.7.81'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 04 01:14:40.561668 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-2c3ac556-73, col_values=(('tag', 2),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:40.562066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-2c3ac556-73, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:40.562516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-2c3ac556-73, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:40.568367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-2c3ac556-73, col_values=(('other_config', {'net_uuid': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:40.579105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade57c7,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 37}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:40.579677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:535 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 15 devices currently available. Time elapsed: 0.023 Sep 04 01:14:40.580258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Preparing device filters for 1 new devices {{(pid=107812) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 04 01:14:40.580716 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Preparing filters for devices {'2c3ac556-7316-478e-a2cf-0863e3b01f18'} Sep 04 01:14:40.582081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information for ports dict_keys([]) {{(pid=107812) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 04 01:14:40.582526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information {{(pid=107812) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 04 01:14:40.586440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 2 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:14:40.624349 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e0b944-8205-4714-bfe9-f8f305f5f747]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:14:40.624992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:535 - agent port security group processed in 0.068 Sep 04 01:14:40.625770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for 2c3ac556-7316-478e-a2cf-0863e3b01f18 to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 01:14:40.862629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Configuration for devices up ['2c3ac556-7316-478e-a2cf-0863e3b01f18'] and devices down [] completed. Sep 04 01:14:40.862999 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:535 - ports processed. Elapsed:0.316 Sep 04 01:14:40.863338 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:535 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.316 Sep 04 01:14:40.920843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Resource Port 2c3ac556-7316-478e-a2cf-0863e3b01f18 updated (revision_number 3->4). Old fields: {'status': 'DOWN', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=2c3ac556-7316-478e-a2cf-0863e3b01f18,segment=NetworkSegment(c26850af-ca47-4ea8-9a33-a34f3381800e),segment_id=c26850af-ca47-4ea8-9a33-a34f3381800e)]} New fields: {'status': 'ACTIVE', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=2c3ac556-7316-478e-a2cf-0863e3b01f18,segment=NetworkSegment(c26850af-ca47-4ea8-9a33-a34f3381800e),segment_id=c26850af-ca47-4ea8-9a33-a34f3381800e)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:14:40.921664 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (2c3ac556-7316-478e-a2cf-0863e3b01f18), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:41.248452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b55eddd8-2c7d-417b-917b-7061e3db4222 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:14:41Z,description='tempest-secgroup-smoke-2067064205 description',id=46402ba3-28d6-4a31-82e5-99b05a90c3c7,is_default=False,name='tempest-secgroup-smoke-2067064205',project_id='2506b96ac13541e6a7a47c5aedca67e5',revision_number=1,rules=[SecurityGroupRule(23f0bcd4-419e-4743-b9ee-1bc0da573239),SecurityGroupRule(259933b8-ef63-4353-841f-aa432e147c11)],shared=False,stateful=True,updated_at=2022-09-04T01:14:41Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:41.248831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b55eddd8-2c7d-417b-917b-7061e3db4222 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (46402ba3-28d6-4a31-82e5-99b05a90c3c7), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:41.249499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b55eddd8-2c7d-417b-917b-7061e3db4222 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:14:41Z,description=,direction='egress',ethertype='IPv6',id=23f0bcd4-419e-4743-b9ee-1bc0da573239,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2506b96ac13541e6a7a47c5aedca67e5',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=46402ba3-28d6-4a31-82e5-99b05a90c3c7,updated_at=2022-09-04T01:14:41Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:41.249853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b55eddd8-2c7d-417b-917b-7061e3db4222 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (23f0bcd4-419e-4743-b9ee-1bc0da573239), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:41.250187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-b55eddd8-2c7d-417b-917b-7061e3db4222 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Security group rule updated ['46402ba3-28d6-4a31-82e5-99b05a90c3c7'] Sep 04 01:14:41.251057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b55eddd8-2c7d-417b-917b-7061e3db4222 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:14:41Z,description=,direction='egress',ethertype='IPv4',id=259933b8-ef63-4353-841f-aa432e147c11,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2506b96ac13541e6a7a47c5aedca67e5',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=46402ba3-28d6-4a31-82e5-99b05a90c3c7,updated_at=2022-09-04T01:14:41Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:41.251414 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b55eddd8-2c7d-417b-917b-7061e3db4222 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (259933b8-ef63-4353-841f-aa432e147c11), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:41.251774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-b55eddd8-2c7d-417b-917b-7061e3db4222 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Security group rule updated ['46402ba3-28d6-4a31-82e5-99b05a90c3c7'] Sep 04 01:14:41.659574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-eae58bba-2e37-4d29-9851-a6efa4b308e8 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:14:41Z,description='',direction='ingress',ethertype='IPv4',id=542c8814-2b98-41e9-a6d7-da8a5ede20fd,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='2506b96ac13541e6a7a47c5aedca67e5',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=46402ba3-28d6-4a31-82e5-99b05a90c3c7,updated_at=2022-09-04T01:14:41Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:41.660236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-eae58bba-2e37-4d29-9851-a6efa4b308e8 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (542c8814-2b98-41e9-a6d7-da8a5ede20fd), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:41.660368 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-eae58bba-2e37-4d29-9851-a6efa4b308e8 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Security group rule updated ['46402ba3-28d6-4a31-82e5-99b05a90c3c7'] Sep 04 01:14:42.022633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-a9e1c1c6-9951-4b6e-b2f9-e6f6515acae9 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:14:41Z,description='',direction='egress',ethertype='IPv4',id=8425d71a-4431-47a2-9473-e64c71a2f5ae,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='2506b96ac13541e6a7a47c5aedca67e5',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=46402ba3-28d6-4a31-82e5-99b05a90c3c7,updated_at=2022-09-04T01:14:41Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:42.023042 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-a9e1c1c6-9951-4b6e-b2f9-e6f6515acae9 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (8425d71a-4431-47a2-9473-e64c71a2f5ae), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:42.023869 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-a9e1c1c6-9951-4b6e-b2f9-e6f6515acae9 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Security group rule updated ['46402ba3-28d6-4a31-82e5-99b05a90c3c7'] Sep 04 01:14:42.386419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-80776eb4-b894-48d0-a5e1-95ec6f61603c tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:14:42Z,description='',direction='ingress',ethertype='IPv4',id=f1621524-468e-4b23-8c14-f21f6c992d64,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2506b96ac13541e6a7a47c5aedca67e5',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=46402ba3-28d6-4a31-82e5-99b05a90c3c7,updated_at=2022-09-04T01:14:42Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:42.389215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-80776eb4-b894-48d0-a5e1-95ec6f61603c tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (f1621524-468e-4b23-8c14-f21f6c992d64), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:42.389215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-80776eb4-b894-48d0-a5e1-95ec6f61603c tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Security group rule updated ['46402ba3-28d6-4a31-82e5-99b05a90c3c7'] Sep 04 01:14:42.427545 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-39c59938-a040-4b62-b54a-25e4cf54395e None None] Resource Port 4e686822-d1bf-4795-baed-c36577dc9ff3 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=4e686822-d1bf-4795-baed-c36577dc9ff3,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=4e686822-d1bf-4795-baed-c36577dc9ff3,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:14:42.428249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-39c59938-a040-4b62-b54a-25e4cf54395e None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (4e686822-d1bf-4795-baed-c36577dc9ff3), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:42.548049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:536 started Sep 04 01:14:42.550956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade57c9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=943000000,duration_sec=1091,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:42.551539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:14:42.551876 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:536 - starting polling. Elapsed:0.004 Sep 04 01:14:42.554111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:42.556981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:536 - port information retrieved. Elapsed:0.009 Sep 04 01:14:42.557365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Starting to process devices in:{'current': {'3fa24970-97a7-4f46-ac55-0b24323fa402', '2c3ac556-7316-478e-a2cf-0863e3b01f18', '82064230-2100-4279-b030-003ad6dab6f1', '5f5b2b5c-f8bd-4ca8-94f2-f4d5e3a6444d', 'cd34646e-9957-4ab9-b15e-f0afcfd59c3b', '89aa06b4-bbf1-40c2-bb48-500c3aecdf48', 'e7120691-3bea-4fb5-9cd0-62e18c24380d', '491c36f8-0074-4f7c-870c-6d117c1f71b6', '20940f6e-c5ec-497b-b144-a180350e4857', '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', '996205b2-4ccc-4913-8458-2e4f1e0e6687', '7f8c6aaa-73de-4cf1-a59c-a00c8f32c2d8', 'c73d8972-0881-4e30-8303-b09f2c82f2f0', '7f2856e4-8bb1-4647-8890-edd403bce7d0', 'ca102ce7-433c-4029-aabf-33d944165ff1'}, 'added': set(), 'removed': set(), 'updated': {'2c3ac556-7316-478e-a2cf-0863e3b01f18'}, 're_added': set()} {{(pid=107812) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 04 01:14:42.557953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': '2c3ac556-7316-478e-a2cf-0863e3b01f18', 'device_id': 'a70adf6d-b889-4681-acc7-04ce1b1c76a6', 'network_id': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'port_id': '2c3ac556-7316-478e-a2cf-0863e3b01f18', 'mac_address': 'fa:16:3e:5b:36:9e', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '2b17f894-c374-4207-90ad-14f794c86627', 'ip_address': '172.37.7.81'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 01:14:42.561505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: 2c3ac556-7316-478e-a2cf-0863e3b01f18 {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:14:42.561835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 2c3ac556-7316-478e-a2cf-0863e3b01f18 updated. Details: {'device': '2c3ac556-7316-478e-a2cf-0863e3b01f18', 'device_id': 'a70adf6d-b889-4681-acc7-04ce1b1c76a6', 'network_id': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'port_id': '2c3ac556-7316-478e-a2cf-0863e3b01f18', 'mac_address': 'fa:16:3e:5b:36:9e', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '2b17f894-c374-4207-90ad-14f794c86627', 'ip_address': '172.37.7.81'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 04 01:14:42.562817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-2c3ac556-73, col_values=(('tag', 2),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:42.563239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-2c3ac556-73, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:42.563639 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-2c3ac556-73, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:42.564088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 01:14:42.565247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-2c3ac556-73, col_values=(('other_config', {'net_uuid': 'e8e0564a-d5c9-4fe0-b2d4-538f45096708', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:42.570799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 01:14:42.570799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade57cb,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 37}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:42.570799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:536 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 15 devices currently available. Time elapsed: 0.011 Sep 04 01:14:42.570799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Refreshing firewall for 1 devices {{(pid=107812) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 04 01:14:42.570799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Refresh firewall rules Sep 04 01:14:42.571202 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information for ports dict_keys([]) {{(pid=107812) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 04 01:14:42.571202 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information {{(pid=107812) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 04 01:14:42.573893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 2 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:14:42.611917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d82157-4dcd-4f91-975a-3229c42015f9]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:14:42.612547 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:536 - agent port security group processed in 0.055 Sep 04 01:14:42.613315 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for 2c3ac556-7316-478e-a2cf-0863e3b01f18 to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 01:14:42.822275 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-9d01d447-d06a-4e1c-9976-12693234a4d7 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:14:42Z,description='',direction='egress',ethertype='IPv4',id=5e5bc260-d0c2-44f9-b0b2-dd1781b7c1d2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2506b96ac13541e6a7a47c5aedca67e5',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=46402ba3-28d6-4a31-82e5-99b05a90c3c7,updated_at=2022-09-04T01:14:42Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:42.822925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-9d01d447-d06a-4e1c-9976-12693234a4d7 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (5e5bc260-d0c2-44f9-b0b2-dd1781b7c1d2), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:42.823340 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-9d01d447-d06a-4e1c-9976-12693234a4d7 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Security group rule updated ['46402ba3-28d6-4a31-82e5-99b05a90c3c7'] Sep 04 01:14:42.903207 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-39c59938-a040-4b62-b54a-25e4cf54395e None None] Resource Port 4e686822-d1bf-4795-baed-c36577dc9ff3 updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=4e686822-d1bf-4795-baed-c36577dc9ff3,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=4e686822-d1bf-4795-baed-c36577dc9ff3,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=4e686822-d1bf-4795-baed-c36577dc9ff3,segment=NetworkSegment(746951e7-0bc8-4b20-aeb2-4159b099caca),segment_id=746951e7-0bc8-4b20-aeb2-4159b099caca)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:14:42.903931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-39c59938-a040-4b62-b54a-25e4cf54395e None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (4e686822-d1bf-4795-baed-c36577dc9ff3), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:43.091932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Configuration for devices up ['2c3ac556-7316-478e-a2cf-0863e3b01f18'] and devices down [] completed. Sep 04 01:14:43.092375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:536 - ports processed. Elapsed:0.544 Sep 04 01:14:43.092792 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:536 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.545 Sep 04 01:14:43.227177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-e4c31f06-e0f8-472b-9d62-ab4112efa817 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:14:43Z,description='',direction='ingress',ethertype='IPv6',id=7edf25a1-5342-4be5-acb2-99b0e8677c56,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2506b96ac13541e6a7a47c5aedca67e5',protocol='ipv6-icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=46402ba3-28d6-4a31-82e5-99b05a90c3c7,updated_at=2022-09-04T01:14:43Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:43.227560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-e4c31f06-e0f8-472b-9d62-ab4112efa817 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (7edf25a1-5342-4be5-acb2-99b0e8677c56), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:43.228084 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-e4c31f06-e0f8-472b-9d62-ab4112efa817 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Security group rule updated ['46402ba3-28d6-4a31-82e5-99b05a90c3c7'] Sep 04 01:14:43.298329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["e36caa31-e30e-496d-b42e-e1c12d36408f","insert","qr-4e686822-d1",["set",[]],["map",[["attached-mac","fa:16:3e:85:6a:3d"],["iface-id","4e686822-d1bf-4795-baed-c36577dc9ff3"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:14:43.324111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["e36caa31-e30e-496d-b42e-e1c12d36408f","old",null,["set",[]],null],["","new","qr-4e686822-d1",38,["map",[["attached-mac","fa:16:3e:85:6a:3d"],["iface-id","4e686822-d1bf-4795-baed-c36577dc9ff3"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:14:43.615977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-10584307-de4c-4745-aa57-ec6d5c72074a tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:14:43Z,description='',direction='egress',ethertype='IPv6',id=044523d6-5970-4588-a93c-1d70f0b40cc0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2506b96ac13541e6a7a47c5aedca67e5',protocol='ipv6-icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=46402ba3-28d6-4a31-82e5-99b05a90c3c7,updated_at=2022-09-04T01:14:43Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:43.616671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-10584307-de4c-4745-aa57-ec6d5c72074a tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (044523d6-5970-4588-a93c-1d70f0b40cc0), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:43.617095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-10584307-de4c-4745-aa57-ec6d5c72074a tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Security group rule updated ['46402ba3-28d6-4a31-82e5-99b05a90c3c7'] Sep 04 01:14:44.549529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:537 started Sep 04 01:14:44.555872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade57cd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=944000000,duration_sec=1093,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:44.556501 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:14:44.556961 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:537 - starting polling. Elapsed:0.008 Sep 04 01:14:44.559342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:44.563375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:537 - port information retrieved. Elapsed:0.014 Sep 04 01:14:44.563708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Starting to process devices in:{'current': {'3fa24970-97a7-4f46-ac55-0b24323fa402', '2c3ac556-7316-478e-a2cf-0863e3b01f18', '82064230-2100-4279-b030-003ad6dab6f1', '5f5b2b5c-f8bd-4ca8-94f2-f4d5e3a6444d', 'cd34646e-9957-4ab9-b15e-f0afcfd59c3b', '89aa06b4-bbf1-40c2-bb48-500c3aecdf48', 'e7120691-3bea-4fb5-9cd0-62e18c24380d', '491c36f8-0074-4f7c-870c-6d117c1f71b6', '20940f6e-c5ec-497b-b144-a180350e4857', '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', '996205b2-4ccc-4913-8458-2e4f1e0e6687', '4e686822-d1bf-4795-baed-c36577dc9ff3', '7f8c6aaa-73de-4cf1-a59c-a00c8f32c2d8', 'c73d8972-0881-4e30-8303-b09f2c82f2f0', '7f2856e4-8bb1-4647-8890-edd403bce7d0', 'ca102ce7-433c-4029-aabf-33d944165ff1'}, 'added': {'4e686822-d1bf-4795-baed-c36577dc9ff3'}, 'removed': set(), 'updated': {'4e686822-d1bf-4795-baed-c36577dc9ff3'}, 're_added': set()} {{(pid=107812) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 04 01:14:44.564263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': '4e686822-d1bf-4795-baed-c36577dc9ff3', 'device_id': 'a70adf6d-b889-4681-acc7-04ce1b1c76a6', 'network_id': '41b67d38-e689-45bb-a406-6607a99ed49b', 'port_id': '4e686822-d1bf-4795-baed-c36577dc9ff3', 'mac_address': 'fa:16:3e:85:6a:3d', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 199, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '223df0be-5574-4032-ab9c-4edcc292cdff', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 01:14:44.567359 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: 4e686822-d1bf-4795-baed-c36577dc9ff3 {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:14:44.567674 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 4e686822-d1bf-4795-baed-c36577dc9ff3 updated. Details: {'device': '4e686822-d1bf-4795-baed-c36577dc9ff3', 'device_id': 'a70adf6d-b889-4681-acc7-04ce1b1c76a6', 'network_id': '41b67d38-e689-45bb-a406-6607a99ed49b', 'port_id': '4e686822-d1bf-4795-baed-c36577dc9ff3', 'mac_address': 'fa:16:3e:85:6a:3d', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 199, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '223df0be-5574-4032-ab9c-4edcc292cdff', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 14} Sep 04 01:14:44.568834 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-4e686822-d1, col_values=(('tag', 14),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:44.573356 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-4e686822-d1, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:44.573844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-4e686822-d1, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:44.581186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-4e686822-d1, col_values=(('other_config', {'net_uuid': '41b67d38-e689-45bb-a406-6607a99ed49b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '14', 'segmentation_id': '199'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:44.608584 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade57cf,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 38}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:44.609023 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:537 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 16 devices currently available. Time elapsed: 0.045 Sep 04 01:14:44.609472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Preparing device filters for 1 new devices {{(pid=107812) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 04 01:14:44.609838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Preparing filters for devices {'4e686822-d1bf-4795-baed-c36577dc9ff3'} Sep 04 01:14:44.611210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information for ports dict_keys([]) {{(pid=107812) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 04 01:14:44.612118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information {{(pid=107812) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 04 01:14:44.616368 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 2 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:14:44.702340 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf0b451-58fd-4c42-9234-c1b76f5b02a6]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:14:44.703105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:537 - agent port security group processed in 0.139 Sep 04 01:14:44.703871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for 4e686822-d1bf-4795-baed-c36577dc9ff3 to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 01:14:44.761695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-bcd64bd4-fbd2-4cab-a547-6946d21ae80f tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:14:44Z,data_plane_status=None,description='',device_id='3b8b93cc-1d4b-4d17-b4d2-e89f42b3be64',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=17937f22-477f-47ec-b6b4-0ea96fee6512,mac_address=fa:16:3e:15:b6:a1,name='',network_id=93fca803-def7-462d-b519-0eb07f4ac511,numa_affinity_policy=,project_id='027792a6118140099aaf522ca15bb07e',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(17937f22-477f-47ec-b6b4-0ea96fee6512),security_group_ids=set([76caf30c-8da1-44c1-bbaa-626b44c17c1d]),status='DOWN',updated_at=2022-09-04T01:14:44Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:44.762827 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-bcd64bd4-fbd2-4cab-a547-6946d21ae80f tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (17937f22-477f-47ec-b6b4-0ea96fee6512), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:44.763473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-bcd64bd4-fbd2-4cab-a547-6946d21ae80f tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Security group member updated {'76caf30c-8da1-44c1-bbaa-626b44c17c1d'} Sep 04 01:14:45.006984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Configuration for devices up ['4e686822-d1bf-4795-baed-c36577dc9ff3'] and devices down [] completed. Sep 04 01:14:45.007818 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:537 - ports processed. Elapsed:0.458 Sep 04 01:14:45.008486 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:537 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.459 Sep 04 01:14:45.071298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Resource Port 4e686822-d1bf-4795-baed-c36577dc9ff3 updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:14:45.071511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b5c537a3-953d-4ce6-bcae-eebc10a06423 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (4e686822-d1bf-4795-baed-c36577dc9ff3), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:45.671322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b0dc2f96-6c6e-41e2-bb10-8a23b99175bf service neutron] Resource Port 17937f22-477f-47ec-b6b4-0ea96fee6512 updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=17937f22-477f-47ec-b6b4-0ea96fee6512,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=17937f22-477f-47ec-b6b4-0ea96fee6512,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:14:45.672709 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b0dc2f96-6c6e-41e2-bb10-8a23b99175bf service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (17937f22-477f-47ec-b6b4-0ea96fee6512), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:46.071705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b0dc2f96-6c6e-41e2-bb10-8a23b99175bf service neutron] Resource Port 17937f22-477f-47ec-b6b4-0ea96fee6512 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=17937f22-477f-47ec-b6b4-0ea96fee6512,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=17937f22-477f-47ec-b6b4-0ea96fee6512,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=17937f22-477f-47ec-b6b4-0ea96fee6512,segment=NetworkSegment(bb3f529c-5ae7-4cc5-a11f-2074c23f8407),segment_id=bb3f529c-5ae7-4cc5-a11f-2074c23f8407)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:14:46.071705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b0dc2f96-6c6e-41e2-bb10-8a23b99175bf service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (17937f22-477f-47ec-b6b4-0ea96fee6512), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:46.551832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:538 started Sep 04 01:14:46.556381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade57d1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=947000000,duration_sec=1095,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:46.557729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:14:46.558547 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:538 - starting polling. Elapsed:0.007 Sep 04 01:14:46.563421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:46.568469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:538 - port information retrieved. Elapsed:0.017 Sep 04 01:14:46.569320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Starting to process devices in:{'current': {'82064230-2100-4279-b030-003ad6dab6f1', 'cd34646e-9957-4ab9-b15e-f0afcfd59c3b', 'e7120691-3bea-4fb5-9cd0-62e18c24380d', '491c36f8-0074-4f7c-870c-6d117c1f71b6', '20940f6e-c5ec-497b-b144-a180350e4857', 'c73d8972-0881-4e30-8303-b09f2c82f2f0', '3fa24970-97a7-4f46-ac55-0b24323fa402', '2c3ac556-7316-478e-a2cf-0863e3b01f18', '5f5b2b5c-f8bd-4ca8-94f2-f4d5e3a6444d', '89aa06b4-bbf1-40c2-bb48-500c3aecdf48', '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', '996205b2-4ccc-4913-8458-2e4f1e0e6687', '4e686822-d1bf-4795-baed-c36577dc9ff3', '7f8c6aaa-73de-4cf1-a59c-a00c8f32c2d8', '7f2856e4-8bb1-4647-8890-edd403bce7d0', 'ca102ce7-433c-4029-aabf-33d944165ff1'}, 'added': set(), 'removed': set(), 'updated': {'4e686822-d1bf-4795-baed-c36577dc9ff3'}, 're_added': set()} {{(pid=107812) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 04 01:14:46.570418 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Returning: {'device': '4e686822-d1bf-4795-baed-c36577dc9ff3', 'device_id': 'a70adf6d-b889-4681-acc7-04ce1b1c76a6', 'network_id': '41b67d38-e689-45bb-a406-6607a99ed49b', 'port_id': '4e686822-d1bf-4795-baed-c36577dc9ff3', 'mac_address': 'fa:16:3e:85:6a:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 199, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '223df0be-5574-4032-ab9c-4edcc292cdff', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107812) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 04 01:14:46.575861 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing port: 4e686822-d1bf-4795-baed-c36577dc9ff3 {{(pid=107812) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 04 01:14:46.576776 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 4e686822-d1bf-4795-baed-c36577dc9ff3 updated. Details: {'device': '4e686822-d1bf-4795-baed-c36577dc9ff3', 'device_id': 'a70adf6d-b889-4681-acc7-04ce1b1c76a6', 'network_id': '41b67d38-e689-45bb-a406-6607a99ed49b', 'port_id': '4e686822-d1bf-4795-baed-c36577dc9ff3', 'mac_address': 'fa:16:3e:85:6a:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 199, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '223df0be-5574-4032-ab9c-4edcc292cdff', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 14} Sep 04 01:14:46.578730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-4e686822-d1, col_values=(('tag', 14),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:46.579700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-4e686822-d1, column=vlan_mode) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:46.580108 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-4e686822-d1, column=trunks) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:46.580647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 01:14:46.581866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-4e686822-d1, col_values=(('other_config', {'net_uuid': '41b67d38-e689-45bb-a406-6607a99ed49b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '199', 'tag': '14'}),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:14:46.583121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 04 01:14:46.586665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade57d3,OFPFlowMod(buffer_id=4294967295,command=4,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 38}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:46.587545 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:538 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 16 devices currently available. Time elapsed: 0.017 Sep 04 01:14:46.588095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Refreshing firewall for 1 devices {{(pid=107812) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 04 01:14:46.588729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Refresh firewall rules Sep 04 01:14:46.591096 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information for ports dict_keys([]) {{(pid=107812) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 04 01:14:46.591874 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Update security group information {{(pid=107812) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 04 01:14:46.599050 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 2 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:14:46.656427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4966a1-b5f6-41b4-a563-2ceeaed99fac]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:14:46.657445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:538 - agent port security group processed in 0.087 Sep 04 01:14:46.658415 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Setting status for 4e686822-d1bf-4795-baed-c36577dc9ff3 to UP {{(pid=107812) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 04 01:14:46.955672 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Configuration for devices up ['4e686822-d1bf-4795-baed-c36577dc9ff3'] and devices down [] completed. Sep 04 01:14:46.956775 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:538 - ports processed. Elapsed:0.405 Sep 04 01:14:46.957378 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:538 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.406 Sep 04 01:14:47.358262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-7dd0f19d-84c5-4df6-abfe-168fbe487402 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:14:47Z,description='Default security group',id=5a703ced-d169-4912-b2f3-0f7abc71c070,is_default=True,name='default',project_id='2ed7dbfcd5804556b351d0113810c6b5',revision_number=1,rules=[SecurityGroupRule(17c47a9c-beeb-40b6-85fd-99f439cc2698),SecurityGroupRule(1ce1f87b-401d-4091-b212-8edbea7fcb55),SecurityGroupRule(c1e1b113-ca62-450c-9b69-a839b886df06),SecurityGroupRule(d261524b-4bb1-46a2-b46e-0130063264c9)],shared=False,stateful=True,updated_at=2022-09-04T01:14:47Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:47.358702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-7dd0f19d-84c5-4df6-abfe-168fbe487402 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (5a703ced-d169-4912-b2f3-0f7abc71c070), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:47.359579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-7dd0f19d-84c5-4df6-abfe-168fbe487402 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:14:47Z,description=,direction='ingress',ethertype='IPv6',id=17c47a9c-beeb-40b6-85fd-99f439cc2698,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2ed7dbfcd5804556b351d0113810c6b5',protocol=,remote_address_group_id=,remote_group_id=5a703ced-d169-4912-b2f3-0f7abc71c070,remote_ip_prefix=,revision_number=0,security_group_id=5a703ced-d169-4912-b2f3-0f7abc71c070,updated_at=2022-09-04T01:14:47Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:47.360192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-7dd0f19d-84c5-4df6-abfe-168fbe487402 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (17c47a9c-beeb-40b6-85fd-99f439cc2698), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:47.361465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-7dd0f19d-84c5-4df6-abfe-168fbe487402 admin admin] Security group rule updated ['5a703ced-d169-4912-b2f3-0f7abc71c070'] Sep 04 01:14:47.362393 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-7dd0f19d-84c5-4df6-abfe-168fbe487402 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:14:47Z,description=,direction='egress',ethertype='IPv6',id=1ce1f87b-401d-4091-b212-8edbea7fcb55,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2ed7dbfcd5804556b351d0113810c6b5',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=5a703ced-d169-4912-b2f3-0f7abc71c070,updated_at=2022-09-04T01:14:47Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:47.363379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-7dd0f19d-84c5-4df6-abfe-168fbe487402 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (1ce1f87b-401d-4091-b212-8edbea7fcb55), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:47.363885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-7dd0f19d-84c5-4df6-abfe-168fbe487402 admin admin] Security group rule updated ['5a703ced-d169-4912-b2f3-0f7abc71c070'] Sep 04 01:14:47.364757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-7dd0f19d-84c5-4df6-abfe-168fbe487402 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:14:47Z,description=,direction='egress',ethertype='IPv4',id=c1e1b113-ca62-450c-9b69-a839b886df06,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2ed7dbfcd5804556b351d0113810c6b5',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=5a703ced-d169-4912-b2f3-0f7abc71c070,updated_at=2022-09-04T01:14:47Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:47.365460 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-7dd0f19d-84c5-4df6-abfe-168fbe487402 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (c1e1b113-ca62-450c-9b69-a839b886df06), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:47.366516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-7dd0f19d-84c5-4df6-abfe-168fbe487402 admin admin] Security group rule updated ['5a703ced-d169-4912-b2f3-0f7abc71c070'] Sep 04 01:14:47.367395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-7dd0f19d-84c5-4df6-abfe-168fbe487402 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:14:47Z,description=,direction='ingress',ethertype='IPv4',id=d261524b-4bb1-46a2-b46e-0130063264c9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2ed7dbfcd5804556b351d0113810c6b5',protocol=,remote_address_group_id=,remote_group_id=5a703ced-d169-4912-b2f3-0f7abc71c070,remote_ip_prefix=,revision_number=0,security_group_id=5a703ced-d169-4912-b2f3-0f7abc71c070,updated_at=2022-09-04T01:14:47Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:47.367913 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-7dd0f19d-84c5-4df6-abfe-168fbe487402 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (d261524b-4bb1-46a2-b46e-0130063264c9), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:47.368406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-7dd0f19d-84c5-4df6-abfe-168fbe487402 admin admin] Security group rule updated ['5a703ced-d169-4912-b2f3-0f7abc71c070'] Sep 04 01:14:47.615473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-53b3ae2e-515a-4ac8-b053-1972a630ffca admin admin] Resource SecurityGroup deleted: 5a703ced-d169-4912-b2f3-0f7abc71c070 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:47.615851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-53b3ae2e-515a-4ac8-b053-1972a630ffca admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (5a703ced-d169-4912-b2f3-0f7abc71c070), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:47.616313 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53b3ae2e-515a-4ac8-b053-1972a630ffca admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('5a703ced-d169-4912-b2f3-0f7abc71c070',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:14:47.638500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-53b3ae2e-515a-4ac8-b053-1972a630ffca admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('5a703ced-d169-4912-b2f3-0f7abc71c070',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:14:47.639747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-53b3ae2e-515a-4ac8-b053-1972a630ffca admin admin] Resource SecurityGroupRule deleted: 17c47a9c-beeb-40b6-85fd-99f439cc2698 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:47.640372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-53b3ae2e-515a-4ac8-b053-1972a630ffca admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (17c47a9c-beeb-40b6-85fd-99f439cc2698), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:47.640981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-53b3ae2e-515a-4ac8-b053-1972a630ffca admin admin] Security group rule updated ['5a703ced-d169-4912-b2f3-0f7abc71c070'] Sep 04 01:14:47.642026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-53b3ae2e-515a-4ac8-b053-1972a630ffca admin admin] Resource SecurityGroupRule deleted: 1ce1f87b-401d-4091-b212-8edbea7fcb55 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:47.645322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-53b3ae2e-515a-4ac8-b053-1972a630ffca admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (1ce1f87b-401d-4091-b212-8edbea7fcb55), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:47.648922 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-53b3ae2e-515a-4ac8-b053-1972a630ffca admin admin] Security group rule updated ['5a703ced-d169-4912-b2f3-0f7abc71c070'] Sep 04 01:14:47.648922 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-53b3ae2e-515a-4ac8-b053-1972a630ffca admin admin] Resource SecurityGroupRule deleted: c1e1b113-ca62-450c-9b69-a839b886df06 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:47.648922 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-53b3ae2e-515a-4ac8-b053-1972a630ffca admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (c1e1b113-ca62-450c-9b69-a839b886df06), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:47.648922 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-53b3ae2e-515a-4ac8-b053-1972a630ffca admin admin] Security group rule updated ['5a703ced-d169-4912-b2f3-0f7abc71c070'] Sep 04 01:14:47.649659 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-53b3ae2e-515a-4ac8-b053-1972a630ffca admin admin] Resource SecurityGroupRule deleted: d261524b-4bb1-46a2-b46e-0130063264c9 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:47.650411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-53b3ae2e-515a-4ac8-b053-1972a630ffca admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (d261524b-4bb1-46a2-b46e-0130063264c9), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:47.650820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-53b3ae2e-515a-4ac8-b053-1972a630ffca admin admin] Security group rule updated ['5a703ced-d169-4912-b2f3-0f7abc71c070'] Sep 04 01:14:48.552863 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:539 started Sep 04 01:14:48.555345 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade57d5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=947000000,duration_sec=1097,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:48.556421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:14:48.556774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:539 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:14:48.616167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-e06f2181-e31a-4408-93b3-7d9ac8eaaed9 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:14:48Z,description='Default security group',id=38af1530-c4c1-4db2-b12b-43d4266e195d,is_default=True,name='default',project_id='3641208e829b41528f461d9bf8d61c5a',revision_number=1,rules=[SecurityGroupRule(0646b930-acb3-4a56-bffb-bd474a647faa),SecurityGroupRule(48f8a067-44ba-4543-9a0e-b4feddca6aa6),SecurityGroupRule(e66911e6-364d-48d7-b671-899c4f1b6e57),SecurityGroupRule(f2ce772e-efbf-4e2e-ac3c-e48bc034c957)],shared=False,stateful=True,updated_at=2022-09-04T01:14:48Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:48.616554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-e06f2181-e31a-4408-93b3-7d9ac8eaaed9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (38af1530-c4c1-4db2-b12b-43d4266e195d), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:48.617211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-e06f2181-e31a-4408-93b3-7d9ac8eaaed9 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:14:48Z,description=,direction='egress',ethertype='IPv4',id=0646b930-acb3-4a56-bffb-bd474a647faa,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3641208e829b41528f461d9bf8d61c5a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=38af1530-c4c1-4db2-b12b-43d4266e195d,updated_at=2022-09-04T01:14:48Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:48.617582 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-e06f2181-e31a-4408-93b3-7d9ac8eaaed9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (0646b930-acb3-4a56-bffb-bd474a647faa), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:48.617914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-e06f2181-e31a-4408-93b3-7d9ac8eaaed9 admin admin] Security group rule updated ['38af1530-c4c1-4db2-b12b-43d4266e195d'] Sep 04 01:14:48.618645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-e06f2181-e31a-4408-93b3-7d9ac8eaaed9 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:14:48Z,description=,direction='ingress',ethertype='IPv6',id=48f8a067-44ba-4543-9a0e-b4feddca6aa6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3641208e829b41528f461d9bf8d61c5a',protocol=,remote_address_group_id=,remote_group_id=38af1530-c4c1-4db2-b12b-43d4266e195d,remote_ip_prefix=,revision_number=0,security_group_id=38af1530-c4c1-4db2-b12b-43d4266e195d,updated_at=2022-09-04T01:14:48Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:48.619290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-e06f2181-e31a-4408-93b3-7d9ac8eaaed9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (48f8a067-44ba-4543-9a0e-b4feddca6aa6), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:48.619634 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-e06f2181-e31a-4408-93b3-7d9ac8eaaed9 admin admin] Security group rule updated ['38af1530-c4c1-4db2-b12b-43d4266e195d'] Sep 04 01:14:48.620331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-e06f2181-e31a-4408-93b3-7d9ac8eaaed9 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:14:48Z,description=,direction='egress',ethertype='IPv6',id=e66911e6-364d-48d7-b671-899c4f1b6e57,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3641208e829b41528f461d9bf8d61c5a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=38af1530-c4c1-4db2-b12b-43d4266e195d,updated_at=2022-09-04T01:14:48Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:48.621099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-e06f2181-e31a-4408-93b3-7d9ac8eaaed9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (e66911e6-364d-48d7-b671-899c4f1b6e57), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:48.621688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-e06f2181-e31a-4408-93b3-7d9ac8eaaed9 admin admin] Security group rule updated ['38af1530-c4c1-4db2-b12b-43d4266e195d'] Sep 04 01:14:48.622840 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-e06f2181-e31a-4408-93b3-7d9ac8eaaed9 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:14:48Z,description=,direction='ingress',ethertype='IPv4',id=f2ce772e-efbf-4e2e-ac3c-e48bc034c957,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3641208e829b41528f461d9bf8d61c5a',protocol=,remote_address_group_id=,remote_group_id=38af1530-c4c1-4db2-b12b-43d4266e195d,remote_ip_prefix=,revision_number=0,security_group_id=38af1530-c4c1-4db2-b12b-43d4266e195d,updated_at=2022-09-04T01:14:48Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:48.623203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-e06f2181-e31a-4408-93b3-7d9ac8eaaed9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (f2ce772e-efbf-4e2e-ac3c-e48bc034c957), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:48.623533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-e06f2181-e31a-4408-93b3-7d9ac8eaaed9 admin admin] Security group rule updated ['38af1530-c4c1-4db2-b12b-43d4266e195d'] Sep 04 01:14:48.877234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-cca50d8a-9e3a-4a48-be55-9bd236a924d8 admin admin] Resource SecurityGroup deleted: 38af1530-c4c1-4db2-b12b-43d4266e195d {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:48.880338 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-cca50d8a-9e3a-4a48-be55-9bd236a924d8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (38af1530-c4c1-4db2-b12b-43d4266e195d), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:48.880338 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cca50d8a-9e3a-4a48-be55-9bd236a924d8 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('38af1530-c4c1-4db2-b12b-43d4266e195d',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:14:48.892636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-cca50d8a-9e3a-4a48-be55-9bd236a924d8 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('38af1530-c4c1-4db2-b12b-43d4266e195d',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:14:48.893390 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-cca50d8a-9e3a-4a48-be55-9bd236a924d8 admin admin] Resource SecurityGroupRule deleted: 0646b930-acb3-4a56-bffb-bd474a647faa {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:48.894044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-cca50d8a-9e3a-4a48-be55-9bd236a924d8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (0646b930-acb3-4a56-bffb-bd474a647faa), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:48.894533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-cca50d8a-9e3a-4a48-be55-9bd236a924d8 admin admin] Security group rule updated ['38af1530-c4c1-4db2-b12b-43d4266e195d'] Sep 04 01:14:48.895325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-cca50d8a-9e3a-4a48-be55-9bd236a924d8 admin admin] Resource SecurityGroupRule deleted: 48f8a067-44ba-4543-9a0e-b4feddca6aa6 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:48.895670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-cca50d8a-9e3a-4a48-be55-9bd236a924d8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (48f8a067-44ba-4543-9a0e-b4feddca6aa6), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:48.895997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-cca50d8a-9e3a-4a48-be55-9bd236a924d8 admin admin] Security group rule updated ['38af1530-c4c1-4db2-b12b-43d4266e195d'] Sep 04 01:14:48.896416 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-cca50d8a-9e3a-4a48-be55-9bd236a924d8 admin admin] Resource SecurityGroupRule deleted: e66911e6-364d-48d7-b671-899c4f1b6e57 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:48.896932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-cca50d8a-9e3a-4a48-be55-9bd236a924d8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (e66911e6-364d-48d7-b671-899c4f1b6e57), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:48.897432 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-cca50d8a-9e3a-4a48-be55-9bd236a924d8 admin admin] Security group rule updated ['38af1530-c4c1-4db2-b12b-43d4266e195d'] Sep 04 01:14:48.898110 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-cca50d8a-9e3a-4a48-be55-9bd236a924d8 admin admin] Resource SecurityGroupRule deleted: f2ce772e-efbf-4e2e-ac3c-e48bc034c957 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:14:48.900504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-cca50d8a-9e3a-4a48-be55-9bd236a924d8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (f2ce772e-efbf-4e2e-ac3c-e48bc034c957), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:48.901389 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-cca50d8a-9e3a-4a48-be55-9bd236a924d8 admin admin] Security group rule updated ['38af1530-c4c1-4db2-b12b-43d4266e195d'] Sep 04 01:14:50.554003 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:540 started Sep 04 01:14:50.556584 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade57d7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=948000000,duration_sec=1099,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:50.557438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:14:50.557785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:540 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:14:50.768244 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-cedb4d68-575a-487f-b81f-1fa7a7230508 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:14:50Z,description='Default security group',id=4c9b8d0a-65de-4988-94b8-77e8452d7080,is_default=True,name='default',project_id='59ba1ddb45594bbd9c53c2ec9f5a8c80',revision_number=1,rules=[SecurityGroupRule(380d9495-39e2-4d3b-89c2-ed3bff057b63),SecurityGroupRule(8832083d-64a1-4fc7-bdd4-dac8b11cd2ff),SecurityGroupRule(d7c66c78-0999-401a-b98c-22512584f6e6),SecurityGroupRule(e0ac9355-d029-4614-94a7-2c7fcccb6444)],shared=False,stateful=True,updated_at=2022-09-04T01:14:50Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:50.768964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-cedb4d68-575a-487f-b81f-1fa7a7230508 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (4c9b8d0a-65de-4988-94b8-77e8452d7080), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:50.769947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-cedb4d68-575a-487f-b81f-1fa7a7230508 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:14:50Z,description=,direction='egress',ethertype='IPv6',id=380d9495-39e2-4d3b-89c2-ed3bff057b63,normalized_cidr=None,port_range_max=,port_range_min=,project_id='59ba1ddb45594bbd9c53c2ec9f5a8c80',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=4c9b8d0a-65de-4988-94b8-77e8452d7080,updated_at=2022-09-04T01:14:50Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:50.770632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-cedb4d68-575a-487f-b81f-1fa7a7230508 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (380d9495-39e2-4d3b-89c2-ed3bff057b63), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:50.771191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-cedb4d68-575a-487f-b81f-1fa7a7230508 admin admin] Security group rule updated ['4c9b8d0a-65de-4988-94b8-77e8452d7080'] Sep 04 01:14:50.772554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-cedb4d68-575a-487f-b81f-1fa7a7230508 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:14:50Z,description=,direction='egress',ethertype='IPv4',id=8832083d-64a1-4fc7-bdd4-dac8b11cd2ff,normalized_cidr=None,port_range_max=,port_range_min=,project_id='59ba1ddb45594bbd9c53c2ec9f5a8c80',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=4c9b8d0a-65de-4988-94b8-77e8452d7080,updated_at=2022-09-04T01:14:50Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:50.773318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-cedb4d68-575a-487f-b81f-1fa7a7230508 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (8832083d-64a1-4fc7-bdd4-dac8b11cd2ff), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:50.781062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-cedb4d68-575a-487f-b81f-1fa7a7230508 admin admin] Security group rule updated ['4c9b8d0a-65de-4988-94b8-77e8452d7080'] Sep 04 01:14:50.781062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-cedb4d68-575a-487f-b81f-1fa7a7230508 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:14:50Z,description=,direction='ingress',ethertype='IPv4',id=d7c66c78-0999-401a-b98c-22512584f6e6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='59ba1ddb45594bbd9c53c2ec9f5a8c80',protocol=,remote_address_group_id=,remote_group_id=4c9b8d0a-65de-4988-94b8-77e8452d7080,remote_ip_prefix=,revision_number=0,security_group_id=4c9b8d0a-65de-4988-94b8-77e8452d7080,updated_at=2022-09-04T01:14:50Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:50.781062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-cedb4d68-575a-487f-b81f-1fa7a7230508 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (d7c66c78-0999-401a-b98c-22512584f6e6), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:50.781062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-cedb4d68-575a-487f-b81f-1fa7a7230508 admin admin] Security group rule updated ['4c9b8d0a-65de-4988-94b8-77e8452d7080'] Sep 04 01:14:50.781545 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-cedb4d68-575a-487f-b81f-1fa7a7230508 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:14:50Z,description=,direction='ingress',ethertype='IPv6',id=e0ac9355-d029-4614-94a7-2c7fcccb6444,normalized_cidr=None,port_range_max=,port_range_min=,project_id='59ba1ddb45594bbd9c53c2ec9f5a8c80',protocol=,remote_address_group_id=,remote_group_id=4c9b8d0a-65de-4988-94b8-77e8452d7080,remote_ip_prefix=,revision_number=0,security_group_id=4c9b8d0a-65de-4988-94b8-77e8452d7080,updated_at=2022-09-04T01:14:50Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:50.781545 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-cedb4d68-575a-487f-b81f-1fa7a7230508 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (e0ac9355-d029-4614-94a7-2c7fcccb6444), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:50.781545 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-cedb4d68-575a-487f-b81f-1fa7a7230508 admin admin] Security group rule updated ['4c9b8d0a-65de-4988-94b8-77e8452d7080'] Sep 04 01:14:51.016566 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-cedb4d68-575a-487f-b81f-1fa7a7230508 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-04T01:14:50Z,description='',dns_domain=None,id=5ddf5173-5570-44e4-b00a-a3c9677c4afe,mtu=1500,name='tempest-VolumesActionsTest-709978942-network',project_id='59ba1ddb45594bbd9c53c2ec9f5a8c80',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(5ddf5173-5570-44e4-b00a-a3c9677c4afe),segments=[NetworkSegment(fd13c416-e1e6-4248-8066-18015fd0cb12)],shared=False,status='ACTIVE',updated_at=2022-09-04T01:14:50Z,vlan_transparent=) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:51.024538 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-cedb4d68-575a-487f-b81f-1fa7a7230508 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533'] for Network (5ddf5173-5570-44e4-b00a-a3c9677c4afe), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:51.112942 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager [None req-cedb4d68-575a-487f-b81f-1fa7a7230508 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 5ddf5173-5570-44e4-b00a-a3c9677c4afe with segmentation id not found. Sep 04 01:14:51.112942 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 04 01:14:51.112942 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 04 01:14:51.112942 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 04 01:14:51.112942 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 04 01:14:51.112942 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 04 01:14:51.112942 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 04 01:14:51.112942 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 04 01:14:51.112942 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 04 01:14:51.112942 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 04 01:14:51.112942 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 04 01:14:51.112942 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 04 01:14:51.112942 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 04 01:14:51.114124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 04 01:14:51.114124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 04 01:14:51.114124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 04 01:14:51.114124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 5ddf5173-5570-44e4-b00a-a3c9677c4afe with segmentation id not found. Sep 04 01:14:51.114124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager Sep 04 01:14:51.535492 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-70e8a76e-fea7-4172-be2d-49e72348b98c admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(17ed4b1d-4f07-4e37-ac28-626ea152fc79)],cidr=172.20.0.0/28,created_at=2022-09-04T01:14:51Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=False,gateway_ip=172.20.0.1,host_routes=[],id=0f25571b-8409-4e9a-b16c-096d53c483c2,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-VolumesActionsTest-709978942-subnet',network_id=5ddf5173-5570-44e4-b00a-a3c9677c4afe,project_id='59ba1ddb45594bbd9c53c2ec9f5a8c80',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-04T01:14:51Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:51.536475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-70e8a76e-fea7-4172-be2d-49e72348b98c admin admin] Publish callbacks [] for Subnet (0f25571b-8409-4e9a-b16c-096d53c483c2), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:52.555688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:541 started Sep 04 01:14:52.560466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade57d9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=951000000,duration_sec=1101,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:52.561332 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:14:52.561920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:541 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 04 01:14:53.098959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-fe345d7e-d387-488f-95dc-84ef7b4012c6 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:14:52Z,description='Default security group',id=e3466541-b70a-4dc4-b6bc-e23641d1c488,is_default=True,name='default',project_id='8d01b0cc21194a16b3dbf2cf7e390ca8',revision_number=1,rules=[SecurityGroupRule(0d3ce3b2-418e-4732-86d8-23f3329afad9),SecurityGroupRule(219acbc4-1311-4644-b350-b087934dd084),SecurityGroupRule(a6bc6a41-64d9-450a-845b-8d4809e348c5),SecurityGroupRule(eb1dd059-f844-4b6d-8c67-b48d6f953fbc)],shared=False,stateful=True,updated_at=2022-09-04T01:14:52Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:53.099341 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-fe345d7e-d387-488f-95dc-84ef7b4012c6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (e3466541-b70a-4dc4-b6bc-e23641d1c488), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:53.099965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-fe345d7e-d387-488f-95dc-84ef7b4012c6 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:14:52Z,description=,direction='egress',ethertype='IPv4',id=0d3ce3b2-418e-4732-86d8-23f3329afad9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8d01b0cc21194a16b3dbf2cf7e390ca8',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e3466541-b70a-4dc4-b6bc-e23641d1c488,updated_at=2022-09-04T01:14:52Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:53.100327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-fe345d7e-d387-488f-95dc-84ef7b4012c6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (0d3ce3b2-418e-4732-86d8-23f3329afad9), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:53.100663 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-fe345d7e-d387-488f-95dc-84ef7b4012c6 admin admin] Security group rule updated ['e3466541-b70a-4dc4-b6bc-e23641d1c488'] Sep 04 01:14:53.101450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-fe345d7e-d387-488f-95dc-84ef7b4012c6 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:14:52Z,description=,direction='ingress',ethertype='IPv6',id=219acbc4-1311-4644-b350-b087934dd084,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8d01b0cc21194a16b3dbf2cf7e390ca8',protocol=,remote_address_group_id=,remote_group_id=e3466541-b70a-4dc4-b6bc-e23641d1c488,remote_ip_prefix=,revision_number=0,security_group_id=e3466541-b70a-4dc4-b6bc-e23641d1c488,updated_at=2022-09-04T01:14:52Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:53.101826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-fe345d7e-d387-488f-95dc-84ef7b4012c6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (219acbc4-1311-4644-b350-b087934dd084), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:53.102157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-fe345d7e-d387-488f-95dc-84ef7b4012c6 admin admin] Security group rule updated ['e3466541-b70a-4dc4-b6bc-e23641d1c488'] Sep 04 01:14:53.102863 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-fe345d7e-d387-488f-95dc-84ef7b4012c6 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:14:52Z,description=,direction='ingress',ethertype='IPv4',id=a6bc6a41-64d9-450a-845b-8d4809e348c5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8d01b0cc21194a16b3dbf2cf7e390ca8',protocol=,remote_address_group_id=,remote_group_id=e3466541-b70a-4dc4-b6bc-e23641d1c488,remote_ip_prefix=,revision_number=0,security_group_id=e3466541-b70a-4dc4-b6bc-e23641d1c488,updated_at=2022-09-04T01:14:52Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:53.103209 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-fe345d7e-d387-488f-95dc-84ef7b4012c6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (a6bc6a41-64d9-450a-845b-8d4809e348c5), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:53.103540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-fe345d7e-d387-488f-95dc-84ef7b4012c6 admin admin] Security group rule updated ['e3466541-b70a-4dc4-b6bc-e23641d1c488'] Sep 04 01:14:53.104243 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-fe345d7e-d387-488f-95dc-84ef7b4012c6 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:14:52Z,description=,direction='egress',ethertype='IPv6',id=eb1dd059-f844-4b6d-8c67-b48d6f953fbc,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8d01b0cc21194a16b3dbf2cf7e390ca8',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e3466541-b70a-4dc4-b6bc-e23641d1c488,updated_at=2022-09-04T01:14:52Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:53.104607 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-fe345d7e-d387-488f-95dc-84ef7b4012c6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (eb1dd059-f844-4b6d-8c67-b48d6f953fbc), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:53.104912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-fe345d7e-d387-488f-95dc-84ef7b4012c6 admin admin] Security group rule updated ['e3466541-b70a-4dc4-b6bc-e23641d1c488'] Sep 04 01:14:53.371593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-fe345d7e-d387-488f-95dc-84ef7b4012c6 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-04T01:14:53Z,description='',dns_domain=None,id=ad579de2-f153-4a3c-af14-a094ac20e2aa,mtu=1500,name='tempest-VolumesActionsTest-1963239120-network',project_id='8d01b0cc21194a16b3dbf2cf7e390ca8',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(ad579de2-f153-4a3c-af14-a094ac20e2aa),segments=[NetworkSegment(d3f7b52b-de4e-4157-a609-7328f44c2a3e)],shared=False,status='ACTIVE',updated_at=2022-09-04T01:14:53Z,vlan_transparent=) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:53.371976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-fe345d7e-d387-488f-95dc-84ef7b4012c6 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533'] for Network (ad579de2-f153-4a3c-af14-a094ac20e2aa), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:53.444210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager [None req-fe345d7e-d387-488f-95dc-84ef7b4012c6 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network ad579de2-f153-4a3c-af14-a094ac20e2aa with segmentation id not found. Sep 04 01:14:53.444210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 04 01:14:53.444210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 04 01:14:53.444210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 04 01:14:53.444210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 04 01:14:53.444210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 04 01:14:53.444210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 04 01:14:53.444210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 04 01:14:53.444210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 04 01:14:53.444210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 04 01:14:53.444210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 04 01:14:53.444210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 04 01:14:53.444210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 04 01:14:53.445312 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 04 01:14:53.445312 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 04 01:14:53.445312 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 04 01:14:53.445312 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network ad579de2-f153-4a3c-af14-a094ac20e2aa with segmentation id not found. Sep 04 01:14:53.445312 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: ERROR neutron_lib.callbacks.manager Sep 04 01:14:54.251874 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-84775d55-7284-4e97-948f-b9b327066b36 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(e47ee250-cee9-43ae-ad95-b49c790dd01b)],cidr=172.20.0.0/28,created_at=2022-09-04T01:14:53Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=False,gateway_ip=172.20.0.1,host_routes=[],id=fd04d848-0bf5-48cb-8e9a-7f288eac9754,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-VolumesActionsTest-1963239120-subnet',network_id=ad579de2-f153-4a3c-af14-a094ac20e2aa,project_id='8d01b0cc21194a16b3dbf2cf7e390ca8',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-04T01:14:53Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:14:54.252533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-84775d55-7284-4e97-948f-b9b327066b36 admin admin] Publish callbacks [] for Subnet (fd04d848-0bf5-48cb-8e9a-7f288eac9754), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:14:54.557643 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:542 started Sep 04 01:14:54.563414 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade57db,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=953000000,duration_sec=1103,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:54.564304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:14:54.565692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:542 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 04 01:14:56.558488 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:543 started Sep 04 01:14:56.561140 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade57dd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=953000000,duration_sec=1105,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:56.561696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:14:56.562039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:543 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:14:58.559846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:544 started Sep 04 01:14:58.563115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade57df,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=955000000,duration_sec=1107,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:14:58.563684 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:14:58.564044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:544 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:14:58.987595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Resource Port 17937f22-477f-47ec-b6b4-0ea96fee6512 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:14:58.987900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (17937f22-477f-47ec-b6b4-0ea96fee6512), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:00.560753 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:545 started Sep 04 01:15:00.563906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade57e1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=956000000,duration_sec=1109,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:15:00.564475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:15:00.564812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:545 - starting polling. Elapsed:0.004 Sep 04 01:15:00.572527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:00.572527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:545 - port information retrieved. Elapsed:0.010 Sep 04 01:15:00.572527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:545 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Sep 04 01:15:00.585177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Resource Port 17937f22-477f-47ec-b6b4-0ea96fee6512 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:15:00.585607 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (17937f22-477f-47ec-b6b4-0ea96fee6512), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:02.561409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:546 started Sep 04 01:15:02.564407 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade57e3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=956000000,duration_sec=1111,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:15:02.564983 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:15:02.565343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:546 - starting polling. Elapsed:0.004 Sep 04 01:15:02.567726 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:02.571643 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:546 - port information retrieved. Elapsed:0.010 Sep 04 01:15:02.571981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:546 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 04 01:15:04.562453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:547 started Sep 04 01:15:04.565032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade57e5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=956000000,duration_sec=1113,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:15:04.565754 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:15:04.566187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:547 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:15:06.564005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:548 started Sep 04 01:15:06.568311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade57e7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=959000000,duration_sec=1115,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:15:06.568884 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:15:06.569259 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:548 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 04 01:15:08.565273 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:549 started Sep 04 01:15:08.572933 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade57e9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=959000000,duration_sec=1117,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:15:08.574024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:15:08.574339 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:549 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 04 01:15:09.699551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-3a788df2-5413-469c-bfea-21a3e5266790 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:15:09Z,data_plane_status=None,description='',device_id='134e1ff6-ab5a-41a8-9afb-8891869494bf',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=8ad76ee4-45f9-4f07-93dd-75ebf95bbe32,mac_address=fa:16:3e:23:5e:77,name='',network_id=ca88993b-9210-4173-b062-c40cdf9e1da6,numa_affinity_policy=,project_id='2506b96ac13541e6a7a47c5aedca67e5',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(8ad76ee4-45f9-4f07-93dd-75ebf95bbe32),security_group_ids=set([46402ba3-28d6-4a31-82e5-99b05a90c3c7]),status='DOWN',updated_at=2022-09-04T01:15:09Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:15:09.700235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-3a788df2-5413-469c-bfea-21a3e5266790 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (8ad76ee4-45f9-4f07-93dd-75ebf95bbe32), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:09.702196 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-3a788df2-5413-469c-bfea-21a3e5266790 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Security group member updated {'46402ba3-28d6-4a31-82e5-99b05a90c3c7'} Sep 04 01:15:10.439255 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-507d479d-bfb1-45fc-b310-3d9cfccd048a service neutron] Resource Port 8ad76ee4-45f9-4f07-93dd-75ebf95bbe32 updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=8ad76ee4-45f9-4f07-93dd-75ebf95bbe32,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=8ad76ee4-45f9-4f07-93dd-75ebf95bbe32,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:15:10.439884 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-507d479d-bfb1-45fc-b310-3d9cfccd048a service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (8ad76ee4-45f9-4f07-93dd-75ebf95bbe32), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:10.566543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:550 started Sep 04 01:15:10.569279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade57eb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=961000000,duration_sec=1119,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:15:10.569853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:15:10.570187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:550 - starting polling. Elapsed:0.004 Sep 04 01:15:10.572446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:10.575441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:550 - port information retrieved. Elapsed:0.009 Sep 04 01:15:10.575793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:550 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 04 01:15:10.726186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-507d479d-bfb1-45fc-b310-3d9cfccd048a service neutron] Resource Port 8ad76ee4-45f9-4f07-93dd-75ebf95bbe32 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=8ad76ee4-45f9-4f07-93dd-75ebf95bbe32,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=8ad76ee4-45f9-4f07-93dd-75ebf95bbe32,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=8ad76ee4-45f9-4f07-93dd-75ebf95bbe32,segment=NetworkSegment(ec3b99f9-cd00-455f-aba9-a56f7e7f2980),segment_id=ec3b99f9-cd00-455f-aba9-a56f7e7f2980)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:15:10.726767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-507d479d-bfb1-45fc-b310-3d9cfccd048a service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (8ad76ee4-45f9-4f07-93dd-75ebf95bbe32), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:11.161776 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-7cf2f789-dc3b-46b3-b4af-6b09df1fc1ab tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:15:10Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=5ec2f0e6-c451-4062-8e28-4836b8b578a1,mac_address=fa:16:3e:a3:fe:92,name='',network_id=e8e0564a-d5c9-4fe0-b2d4-538f45096708,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(5ec2f0e6-c451-4062-8e28-4836b8b578a1),security_group_ids=set([]),status='N/A',updated_at=2022-09-04T01:15:10Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:15:11.162165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-7cf2f789-dc3b-46b3-b4af-6b09df1fc1ab tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (5ec2f0e6-c451-4062-8e28-4836b8b578a1), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:12.145657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-6ea106a3-a64d-4b43-b35b-3817ccd651ae admin admin] Resource Subnet deleted: 0f25571b-8409-4e9a-b16c-096d53c483c2 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:15:12.146200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-6ea106a3-a64d-4b43-b35b-3817ccd651ae admin admin] Publish callbacks [] for Subnet (0f25571b-8409-4e9a-b16c-096d53c483c2), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:12.163438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-7cf2f789-dc3b-46b3-b4af-6b09df1fc1ab tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Resource Port 5ec2f0e6-c451-4062-8e28-4836b8b578a1 updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': '12d3bdb8-a49f-4833-97e5-ffdf79750b16'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:15:12.164064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-7cf2f789-dc3b-46b3-b4af-6b09df1fc1ab tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (5ec2f0e6-c451-4062-8e28-4836b8b578a1), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:12.531162 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-8b45c323-b0b3-4c92-8d0e-d8dd7af8ff0b admin admin] Resource Network deleted: 5ddf5173-5570-44e4-b00a-a3c9677c4afe {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:15:12.532757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-8b45c323-b0b3-4c92-8d0e-d8dd7af8ff0b admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533'] for Network (5ddf5173-5570-44e4-b00a-a3c9677c4afe), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:12.566995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:551 started Sep 04 01:15:12.569436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade57ed,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=961000000,duration_sec=1121,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:15:12.570019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:15:12.570359 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:551 - starting polling. Elapsed:0.004 Sep 04 01:15:12.572700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:12.575710 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:551 - port information retrieved. Elapsed:0.009 Sep 04 01:15:12.576045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:551 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 04 01:15:13.002280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-57d1aafc-d5e4-4e9d-acf9-92c9f06cb28c admin admin] Resource Subnet deleted: fd04d848-0bf5-48cb-8e9a-7f288eac9754 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:15:13.002747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-57d1aafc-d5e4-4e9d-acf9-92c9f06cb28c admin admin] Publish callbacks [] for Subnet (fd04d848-0bf5-48cb-8e9a-7f288eac9754), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:13.363139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4c2342a6-8624-4f3d-9354-d7ce4e3c3435 tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:15:13Z,description='tempest-secgroup-smoke-264434114 description',id=453a92ae-fa58-40a9-8940-f7ae3987450a,is_default=False,name='tempest-secgroup-smoke-264434114',project_id='027792a6118140099aaf522ca15bb07e',revision_number=1,rules=[SecurityGroupRule(15d8f5bb-02e7-4f3f-a98c-bb86a1c57096),SecurityGroupRule(7e1b3ca0-b19e-4d71-b80a-48736a1fa340)],shared=False,stateful=True,updated_at=2022-09-04T01:15:13Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:15:13.363837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4c2342a6-8624-4f3d-9354-d7ce4e3c3435 tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (453a92ae-fa58-40a9-8940-f7ae3987450a), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:13.364224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4c2342a6-8624-4f3d-9354-d7ce4e3c3435 tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:15:13Z,description=,direction='egress',ethertype='IPv4',id=15d8f5bb-02e7-4f3f-a98c-bb86a1c57096,normalized_cidr=None,port_range_max=,port_range_min=,project_id='027792a6118140099aaf522ca15bb07e',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=453a92ae-fa58-40a9-8940-f7ae3987450a,updated_at=2022-09-04T01:15:13Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:15:13.364605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4c2342a6-8624-4f3d-9354-d7ce4e3c3435 tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (15d8f5bb-02e7-4f3f-a98c-bb86a1c57096), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:13.365067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-4c2342a6-8624-4f3d-9354-d7ce4e3c3435 tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Security group rule updated ['453a92ae-fa58-40a9-8940-f7ae3987450a'] Sep 04 01:15:13.365834 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4c2342a6-8624-4f3d-9354-d7ce4e3c3435 tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:15:13Z,description=,direction='egress',ethertype='IPv6',id=7e1b3ca0-b19e-4d71-b80a-48736a1fa340,normalized_cidr=None,port_range_max=,port_range_min=,project_id='027792a6118140099aaf522ca15bb07e',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=453a92ae-fa58-40a9-8940-f7ae3987450a,updated_at=2022-09-04T01:15:13Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:15:13.366311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4c2342a6-8624-4f3d-9354-d7ce4e3c3435 tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (7e1b3ca0-b19e-4d71-b80a-48736a1fa340), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:13.366641 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-4c2342a6-8624-4f3d-9354-d7ce4e3c3435 tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Security group rule updated ['453a92ae-fa58-40a9-8940-f7ae3987450a'] Sep 04 01:15:13.435023 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-5a007215-a568-4a8a-b277-c1ac88ccc519 admin admin] Resource Network deleted: ad579de2-f153-4a3c-af14-a094ac20e2aa {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:15:13.435496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-5a007215-a568-4a8a-b277-c1ac88ccc519 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533'] for Network (ad579de2-f153-4a3c-af14-a094ac20e2aa), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:13.859310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-3d2a22e5-93e1-49b1-930c-7d8a18c905bc tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:15:13Z,description='',direction='ingress',ethertype='IPv4',id=bdf15ac6-c80b-46cf-81b8-693e71b7cba6,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='027792a6118140099aaf522ca15bb07e',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=453a92ae-fa58-40a9-8940-f7ae3987450a,updated_at=2022-09-04T01:15:13Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:15:13.860910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-3d2a22e5-93e1-49b1-930c-7d8a18c905bc tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (bdf15ac6-c80b-46cf-81b8-693e71b7cba6), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:13.861303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-3d2a22e5-93e1-49b1-930c-7d8a18c905bc tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Security group rule updated ['453a92ae-fa58-40a9-8940-f7ae3987450a'] Sep 04 01:15:14.128306 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-27526dbc-7837-4850-88fc-18b556fe923c admin admin] Resource SecurityGroup deleted: 4c9b8d0a-65de-4988-94b8-77e8452d7080 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:15:14.129285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-27526dbc-7837-4850-88fc-18b556fe923c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (4c9b8d0a-65de-4988-94b8-77e8452d7080), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:14.130749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27526dbc-7837-4850-88fc-18b556fe923c admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('4c9b8d0a-65de-4988-94b8-77e8452d7080',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:15:14.176546 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-27526dbc-7837-4850-88fc-18b556fe923c admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('4c9b8d0a-65de-4988-94b8-77e8452d7080',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:15:14.177183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-27526dbc-7837-4850-88fc-18b556fe923c admin admin] Resource SecurityGroupRule deleted: 380d9495-39e2-4d3b-89c2-ed3bff057b63 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:15:14.177558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-27526dbc-7837-4850-88fc-18b556fe923c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (380d9495-39e2-4d3b-89c2-ed3bff057b63), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:14.177974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-27526dbc-7837-4850-88fc-18b556fe923c admin admin] Security group rule updated ['4c9b8d0a-65de-4988-94b8-77e8452d7080'] Sep 04 01:15:14.178393 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-27526dbc-7837-4850-88fc-18b556fe923c admin admin] Resource SecurityGroupRule deleted: 8832083d-64a1-4fc7-bdd4-dac8b11cd2ff {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:15:14.178959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-27526dbc-7837-4850-88fc-18b556fe923c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (8832083d-64a1-4fc7-bdd4-dac8b11cd2ff), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:14.179461 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-27526dbc-7837-4850-88fc-18b556fe923c admin admin] Security group rule updated ['4c9b8d0a-65de-4988-94b8-77e8452d7080'] Sep 04 01:15:14.179884 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-27526dbc-7837-4850-88fc-18b556fe923c admin admin] Resource SecurityGroupRule deleted: d7c66c78-0999-401a-b98c-22512584f6e6 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:15:14.180382 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-27526dbc-7837-4850-88fc-18b556fe923c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (d7c66c78-0999-401a-b98c-22512584f6e6), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:14.180698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-27526dbc-7837-4850-88fc-18b556fe923c admin admin] Security group rule updated ['4c9b8d0a-65de-4988-94b8-77e8452d7080'] Sep 04 01:15:14.181367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-27526dbc-7837-4850-88fc-18b556fe923c admin admin] Resource SecurityGroupRule deleted: e0ac9355-d029-4614-94a7-2c7fcccb6444 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:15:14.181710 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-27526dbc-7837-4850-88fc-18b556fe923c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (e0ac9355-d029-4614-94a7-2c7fcccb6444), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:14.182051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-27526dbc-7837-4850-88fc-18b556fe923c admin admin] Security group rule updated ['4c9b8d0a-65de-4988-94b8-77e8452d7080'] Sep 04 01:15:14.261686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-643c7761-dafd-45e7-beea-f8816bd9d682 tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:15:14Z,description='',direction='egress',ethertype='IPv4',id=ebd13a01-f1c0-4f18-82c6-a8bb2ec41b62,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='027792a6118140099aaf522ca15bb07e',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=453a92ae-fa58-40a9-8940-f7ae3987450a,updated_at=2022-09-04T01:15:14Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:15:14.262088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-643c7761-dafd-45e7-beea-f8816bd9d682 tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (ebd13a01-f1c0-4f18-82c6-a8bb2ec41b62), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:14.262425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-643c7761-dafd-45e7-beea-f8816bd9d682 tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Security group rule updated ['453a92ae-fa58-40a9-8940-f7ae3987450a'] Sep 04 01:15:14.567851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:552 started Sep 04 01:15:14.570421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade57ef,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=962000000,duration_sec=1123,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:15:14.571089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:15:14.571444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:552 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:15:14.593251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-df29bc14-99e7-43f0-900f-99b88c9427bc tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:15:14Z,description='',direction='ingress',ethertype='IPv4',id=80ee7d29-9727-4416-9f56-ede8e8f2ae9d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='027792a6118140099aaf522ca15bb07e',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=453a92ae-fa58-40a9-8940-f7ae3987450a,updated_at=2022-09-04T01:15:14Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:15:14.593633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-df29bc14-99e7-43f0-900f-99b88c9427bc tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (80ee7d29-9727-4416-9f56-ede8e8f2ae9d), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:14.594198 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-df29bc14-99e7-43f0-900f-99b88c9427bc tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Security group rule updated ['453a92ae-fa58-40a9-8940-f7ae3987450a'] Sep 04 01:15:14.968606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-a045f4e7-c14b-4d9a-8499-f63c5c57ed2f tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:15:14Z,description='',direction='egress',ethertype='IPv4',id=e4f724e4-617d-4d52-b840-fad04c7e455d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='027792a6118140099aaf522ca15bb07e',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=453a92ae-fa58-40a9-8940-f7ae3987450a,updated_at=2022-09-04T01:15:14Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:15:14.969681 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-a045f4e7-c14b-4d9a-8499-f63c5c57ed2f tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (e4f724e4-617d-4d52-b840-fad04c7e455d), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:14.970047 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-a045f4e7-c14b-4d9a-8499-f63c5c57ed2f tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Security group rule updated ['453a92ae-fa58-40a9-8940-f7ae3987450a'] Sep 04 01:15:15.092775 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-f1d7ae4a-9bf7-432e-9fe3-59f9fde0aaf3 admin admin] Resource SecurityGroup deleted: e3466541-b70a-4dc4-b6bc-e23641d1c488 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:15:15.093332 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-f1d7ae4a-9bf7-432e-9fe3-59f9fde0aaf3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (e3466541-b70a-4dc4-b6bc-e23641d1c488), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:15.093797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1d7ae4a-9bf7-432e-9fe3-59f9fde0aaf3 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('e3466541-b70a-4dc4-b6bc-e23641d1c488',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:15:15.107238 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-f1d7ae4a-9bf7-432e-9fe3-59f9fde0aaf3 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('e3466541-b70a-4dc4-b6bc-e23641d1c488',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:15:15.107788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-f1d7ae4a-9bf7-432e-9fe3-59f9fde0aaf3 admin admin] Resource SecurityGroupRule deleted: 0d3ce3b2-418e-4732-86d8-23f3329afad9 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:15:15.108157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-f1d7ae4a-9bf7-432e-9fe3-59f9fde0aaf3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (0d3ce3b2-418e-4732-86d8-23f3329afad9), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:15.108517 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-f1d7ae4a-9bf7-432e-9fe3-59f9fde0aaf3 admin admin] Security group rule updated ['e3466541-b70a-4dc4-b6bc-e23641d1c488'] Sep 04 01:15:15.108954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-f1d7ae4a-9bf7-432e-9fe3-59f9fde0aaf3 admin admin] Resource SecurityGroupRule deleted: 219acbc4-1311-4644-b350-b087934dd084 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:15:15.109428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-f1d7ae4a-9bf7-432e-9fe3-59f9fde0aaf3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (219acbc4-1311-4644-b350-b087934dd084), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:15.114687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-f1d7ae4a-9bf7-432e-9fe3-59f9fde0aaf3 admin admin] Security group rule updated ['e3466541-b70a-4dc4-b6bc-e23641d1c488'] Sep 04 01:15:15.114687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-f1d7ae4a-9bf7-432e-9fe3-59f9fde0aaf3 admin admin] Resource SecurityGroupRule deleted: a6bc6a41-64d9-450a-845b-8d4809e348c5 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:15:15.114687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-f1d7ae4a-9bf7-432e-9fe3-59f9fde0aaf3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (a6bc6a41-64d9-450a-845b-8d4809e348c5), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:15.114687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-f1d7ae4a-9bf7-432e-9fe3-59f9fde0aaf3 admin admin] Security group rule updated ['e3466541-b70a-4dc4-b6bc-e23641d1c488'] Sep 04 01:15:15.114687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-f1d7ae4a-9bf7-432e-9fe3-59f9fde0aaf3 admin admin] Resource SecurityGroupRule deleted: eb1dd059-f844-4b6d-8c67-b48d6f953fbc {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:15:15.115233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-f1d7ae4a-9bf7-432e-9fe3-59f9fde0aaf3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (eb1dd059-f844-4b6d-8c67-b48d6f953fbc), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:15.115233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-f1d7ae4a-9bf7-432e-9fe3-59f9fde0aaf3 admin admin] Security group rule updated ['e3466541-b70a-4dc4-b6bc-e23641d1c488'] Sep 04 01:15:15.432151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-3a4d4272-bbb9-4190-80c1-4d007d3d0d04 tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:15:15Z,description='',direction='ingress',ethertype='IPv6',id=3eb8b7cb-426b-4754-95bb-ff8e9e2757e0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='027792a6118140099aaf522ca15bb07e',protocol='ipv6-icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=453a92ae-fa58-40a9-8940-f7ae3987450a,updated_at=2022-09-04T01:15:15Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:15:15.432679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-3a4d4272-bbb9-4190-80c1-4d007d3d0d04 tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (3eb8b7cb-426b-4754-95bb-ff8e9e2757e0), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:15.433148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-3a4d4272-bbb9-4190-80c1-4d007d3d0d04 tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Security group rule updated ['453a92ae-fa58-40a9-8940-f7ae3987450a'] Sep 04 01:15:15.758053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-add89f64-bedf-4139-981b-516bee822bab tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:15:15Z,description='',direction='egress',ethertype='IPv6',id=84d006c8-de01-441c-b81e-9095178cca26,normalized_cidr=None,port_range_max=,port_range_min=,project_id='027792a6118140099aaf522ca15bb07e',protocol='ipv6-icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=453a92ae-fa58-40a9-8940-f7ae3987450a,updated_at=2022-09-04T01:15:15Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:15:15.758746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-add89f64-bedf-4139-981b-516bee822bab tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (84d006c8-de01-441c-b81e-9095178cca26), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:15.758746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-add89f64-bedf-4139-981b-516bee822bab tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Security group rule updated ['453a92ae-fa58-40a9-8940-f7ae3987450a'] Sep 04 01:15:16.445961 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c841fc8d-8232-4841-aa17-2d2db5db2210 tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Resource Port 17937f22-477f-47ec-b6b4-0ea96fee6512 updated (revision_number 5->6). Old fields: {'security_group_ids': CoercedSet({'76caf30c-8da1-44c1-bbaa-626b44c17c1d'})} New fields: {'security_group_ids': CoercedSet({'76caf30c-8da1-44c1-bbaa-626b44c17c1d', '453a92ae-fa58-40a9-8940-f7ae3987450a'})} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:15:16.446399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-c841fc8d-8232-4841-aa17-2d2db5db2210 tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (17937f22-477f-47ec-b6b4-0ea96fee6512), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:16.446924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-c841fc8d-8232-4841-aa17-2d2db5db2210 tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Security group member updated {'76caf30c-8da1-44c1-bbaa-626b44c17c1d', '453a92ae-fa58-40a9-8940-f7ae3987450a'} Sep 04 01:15:16.568489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:553 started Sep 04 01:15:16.572340 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade57f1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=963000000,duration_sec=1125,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:15:16.573422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:15:16.574085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:553 - starting polling. Elapsed:0.006 Sep 04 01:15:16.577428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:16.581683 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:553 - port information retrieved. Elapsed:0.013 Sep 04 01:15:16.582299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:553 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.014 Sep 04 01:15:17.189731 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-5523cde7-c4e0-4be7-b071-0713a418f498 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:15:16Z,description='Default security group',id=102d07ad-dc41-41fe-8310-db094ef7a572,is_default=True,name='default',project_id='2215c39caa2847f8b7b69343f3a4278f',revision_number=1,rules=[SecurityGroupRule(16f22867-813a-48b5-8bd6-2b679d725156),SecurityGroupRule(2d8d53dd-fb0d-4666-8b06-9bb713b2e163),SecurityGroupRule(c533633b-f0eb-42ff-828d-d03e82729c29),SecurityGroupRule(f95d83fc-f409-4910-a133-fe856750ddb6)],shared=False,stateful=True,updated_at=2022-09-04T01:15:17Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:15:17.190370 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-5523cde7-c4e0-4be7-b071-0713a418f498 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (102d07ad-dc41-41fe-8310-db094ef7a572), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:17.190716 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-5523cde7-c4e0-4be7-b071-0713a418f498 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:15:17Z,description=,direction='ingress',ethertype='IPv4',id=16f22867-813a-48b5-8bd6-2b679d725156,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2215c39caa2847f8b7b69343f3a4278f',protocol=,remote_address_group_id=,remote_group_id=102d07ad-dc41-41fe-8310-db094ef7a572,remote_ip_prefix=,revision_number=0,security_group_id=102d07ad-dc41-41fe-8310-db094ef7a572,updated_at=2022-09-04T01:15:17Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:15:17.191076 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-5523cde7-c4e0-4be7-b071-0713a418f498 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (16f22867-813a-48b5-8bd6-2b679d725156), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:17.191408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-5523cde7-c4e0-4be7-b071-0713a418f498 admin admin] Security group rule updated ['102d07ad-dc41-41fe-8310-db094ef7a572'] Sep 04 01:15:17.192112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-5523cde7-c4e0-4be7-b071-0713a418f498 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:15:17Z,description=,direction='egress',ethertype='IPv6',id=2d8d53dd-fb0d-4666-8b06-9bb713b2e163,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2215c39caa2847f8b7b69343f3a4278f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=102d07ad-dc41-41fe-8310-db094ef7a572,updated_at=2022-09-04T01:15:17Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:15:17.192461 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-5523cde7-c4e0-4be7-b071-0713a418f498 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (2d8d53dd-fb0d-4666-8b06-9bb713b2e163), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:17.192787 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-5523cde7-c4e0-4be7-b071-0713a418f498 admin admin] Security group rule updated ['102d07ad-dc41-41fe-8310-db094ef7a572'] Sep 04 01:15:17.193705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-5523cde7-c4e0-4be7-b071-0713a418f498 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:15:17Z,description=,direction='ingress',ethertype='IPv6',id=c533633b-f0eb-42ff-828d-d03e82729c29,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2215c39caa2847f8b7b69343f3a4278f',protocol=,remote_address_group_id=,remote_group_id=102d07ad-dc41-41fe-8310-db094ef7a572,remote_ip_prefix=,revision_number=0,security_group_id=102d07ad-dc41-41fe-8310-db094ef7a572,updated_at=2022-09-04T01:15:17Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:15:17.194060 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-5523cde7-c4e0-4be7-b071-0713a418f498 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (c533633b-f0eb-42ff-828d-d03e82729c29), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:17.194400 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-5523cde7-c4e0-4be7-b071-0713a418f498 admin admin] Security group rule updated ['102d07ad-dc41-41fe-8310-db094ef7a572'] Sep 04 01:15:17.195130 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-5523cde7-c4e0-4be7-b071-0713a418f498 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:15:17Z,description=,direction='egress',ethertype='IPv4',id=f95d83fc-f409-4910-a133-fe856750ddb6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2215c39caa2847f8b7b69343f3a4278f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=102d07ad-dc41-41fe-8310-db094ef7a572,updated_at=2022-09-04T01:15:17Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:15:17.195475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-5523cde7-c4e0-4be7-b071-0713a418f498 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (f95d83fc-f409-4910-a133-fe856750ddb6), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:17.195800 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-5523cde7-c4e0-4be7-b071-0713a418f498 admin admin] Security group rule updated ['102d07ad-dc41-41fe-8310-db094ef7a572'] Sep 04 01:15:17.458590 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-7ef41441-856e-4f96-aef2-274cedd9a727 admin admin] Resource SecurityGroup deleted: 102d07ad-dc41-41fe-8310-db094ef7a572 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:15:17.460591 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-7ef41441-856e-4f96-aef2-274cedd9a727 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (102d07ad-dc41-41fe-8310-db094ef7a572), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:17.460591 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ef41441-856e-4f96-aef2-274cedd9a727 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('102d07ad-dc41-41fe-8310-db094ef7a572',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:15:17.475408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-7ef41441-856e-4f96-aef2-274cedd9a727 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('102d07ad-dc41-41fe-8310-db094ef7a572',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:15:17.475913 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-7ef41441-856e-4f96-aef2-274cedd9a727 admin admin] Resource SecurityGroupRule deleted: 16f22867-813a-48b5-8bd6-2b679d725156 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:15:17.476274 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-7ef41441-856e-4f96-aef2-274cedd9a727 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (16f22867-813a-48b5-8bd6-2b679d725156), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:17.476606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-7ef41441-856e-4f96-aef2-274cedd9a727 admin admin] Security group rule updated ['102d07ad-dc41-41fe-8310-db094ef7a572'] Sep 04 01:15:17.477045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-7ef41441-856e-4f96-aef2-274cedd9a727 admin admin] Resource SecurityGroupRule deleted: 2d8d53dd-fb0d-4666-8b06-9bb713b2e163 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:15:17.477425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-7ef41441-856e-4f96-aef2-274cedd9a727 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (2d8d53dd-fb0d-4666-8b06-9bb713b2e163), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:17.477741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-7ef41441-856e-4f96-aef2-274cedd9a727 admin admin] Security group rule updated ['102d07ad-dc41-41fe-8310-db094ef7a572'] Sep 04 01:15:17.478164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-7ef41441-856e-4f96-aef2-274cedd9a727 admin admin] Resource SecurityGroupRule deleted: c533633b-f0eb-42ff-828d-d03e82729c29 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:15:17.478502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-7ef41441-856e-4f96-aef2-274cedd9a727 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (c533633b-f0eb-42ff-828d-d03e82729c29), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:17.478816 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-7ef41441-856e-4f96-aef2-274cedd9a727 admin admin] Security group rule updated ['102d07ad-dc41-41fe-8310-db094ef7a572'] Sep 04 01:15:17.479223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-7ef41441-856e-4f96-aef2-274cedd9a727 admin admin] Resource SecurityGroupRule deleted: f95d83fc-f409-4910-a133-fe856750ddb6 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:15:17.479569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-7ef41441-856e-4f96-aef2-274cedd9a727 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (f95d83fc-f409-4910-a133-fe856750ddb6), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:17.479868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-7ef41441-856e-4f96-aef2-274cedd9a727 admin admin] Security group rule updated ['102d07ad-dc41-41fe-8310-db094ef7a572'] Sep 04 01:15:18.569539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:554 started Sep 04 01:15:18.572234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade57f3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=964000000,duration_sec=1127,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:15:18.572987 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:15:18.573600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:554 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:15:18.675196 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Resource Port 8ad76ee4-45f9-4f07-93dd-75ebf95bbe32 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:15:18.675775 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (8ad76ee4-45f9-4f07-93dd-75ebf95bbe32), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:19.479249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-9fd6df23-c6d0-4a49-afe4-98c8b1163f46 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:15:19Z,description='Default security group',id=c53fb04d-0fc7-4cad-a436-6d3f475e2da4,is_default=True,name='default',project_id='366b418257664a79b3c1d3f373c7ac5b',revision_number=1,rules=[SecurityGroupRule(2d190e70-7eb7-40fc-8442-310dbdfdde61),SecurityGroupRule(76a8fc5b-ad36-41c1-b0c3-f30778a38a45),SecurityGroupRule(988dd59e-523d-4405-88e3-6bf479ba4737),SecurityGroupRule(abea4b20-9f13-47bf-a5c2-466472bbbc1a)],shared=False,stateful=True,updated_at=2022-09-04T01:15:19Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:15:19.479633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-9fd6df23-c6d0-4a49-afe4-98c8b1163f46 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (c53fb04d-0fc7-4cad-a436-6d3f475e2da4), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:19.480245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-9fd6df23-c6d0-4a49-afe4-98c8b1163f46 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:15:19Z,description=,direction='egress',ethertype='IPv6',id=2d190e70-7eb7-40fc-8442-310dbdfdde61,normalized_cidr=None,port_range_max=,port_range_min=,project_id='366b418257664a79b3c1d3f373c7ac5b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c53fb04d-0fc7-4cad-a436-6d3f475e2da4,updated_at=2022-09-04T01:15:19Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:15:19.480601 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-9fd6df23-c6d0-4a49-afe4-98c8b1163f46 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (2d190e70-7eb7-40fc-8442-310dbdfdde61), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:19.480930 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-9fd6df23-c6d0-4a49-afe4-98c8b1163f46 admin admin] Security group rule updated ['c53fb04d-0fc7-4cad-a436-6d3f475e2da4'] Sep 04 01:15:19.481655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-9fd6df23-c6d0-4a49-afe4-98c8b1163f46 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:15:19Z,description=,direction='egress',ethertype='IPv4',id=76a8fc5b-ad36-41c1-b0c3-f30778a38a45,normalized_cidr=None,port_range_max=,port_range_min=,project_id='366b418257664a79b3c1d3f373c7ac5b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c53fb04d-0fc7-4cad-a436-6d3f475e2da4,updated_at=2022-09-04T01:15:19Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:15:19.482080 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-9fd6df23-c6d0-4a49-afe4-98c8b1163f46 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (76a8fc5b-ad36-41c1-b0c3-f30778a38a45), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:19.482455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-9fd6df23-c6d0-4a49-afe4-98c8b1163f46 admin admin] Security group rule updated ['c53fb04d-0fc7-4cad-a436-6d3f475e2da4'] Sep 04 01:15:19.483103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-9fd6df23-c6d0-4a49-afe4-98c8b1163f46 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:15:19Z,description=,direction='ingress',ethertype='IPv4',id=988dd59e-523d-4405-88e3-6bf479ba4737,normalized_cidr=None,port_range_max=,port_range_min=,project_id='366b418257664a79b3c1d3f373c7ac5b',protocol=,remote_address_group_id=,remote_group_id=c53fb04d-0fc7-4cad-a436-6d3f475e2da4,remote_ip_prefix=,revision_number=0,security_group_id=c53fb04d-0fc7-4cad-a436-6d3f475e2da4,updated_at=2022-09-04T01:15:19Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:15:19.483484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-9fd6df23-c6d0-4a49-afe4-98c8b1163f46 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (988dd59e-523d-4405-88e3-6bf479ba4737), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:19.483811 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-9fd6df23-c6d0-4a49-afe4-98c8b1163f46 admin admin] Security group rule updated ['c53fb04d-0fc7-4cad-a436-6d3f475e2da4'] Sep 04 01:15:19.484532 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-9fd6df23-c6d0-4a49-afe4-98c8b1163f46 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:15:19Z,description=,direction='ingress',ethertype='IPv6',id=abea4b20-9f13-47bf-a5c2-466472bbbc1a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='366b418257664a79b3c1d3f373c7ac5b',protocol=,remote_address_group_id=,remote_group_id=c53fb04d-0fc7-4cad-a436-6d3f475e2da4,remote_ip_prefix=,revision_number=0,security_group_id=c53fb04d-0fc7-4cad-a436-6d3f475e2da4,updated_at=2022-09-04T01:15:19Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:15:19.484877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-9fd6df23-c6d0-4a49-afe4-98c8b1163f46 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (abea4b20-9f13-47bf-a5c2-466472bbbc1a), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:19.485223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-9fd6df23-c6d0-4a49-afe4-98c8b1163f46 admin admin] Security group rule updated ['c53fb04d-0fc7-4cad-a436-6d3f475e2da4'] Sep 04 01:15:19.698060 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4e25a16b-53c2-4e20-a44b-7980e7109d45 admin admin] Resource SecurityGroup deleted: c53fb04d-0fc7-4cad-a436-6d3f475e2da4 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:15:19.698703 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4e25a16b-53c2-4e20-a44b-7980e7109d45 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (c53fb04d-0fc7-4cad-a436-6d3f475e2da4), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:19.699105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e25a16b-53c2-4e20-a44b-7980e7109d45 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('c53fb04d-0fc7-4cad-a436-6d3f475e2da4',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:15:19.715101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4e25a16b-53c2-4e20-a44b-7980e7109d45 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('c53fb04d-0fc7-4cad-a436-6d3f475e2da4',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:15:19.720519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4e25a16b-53c2-4e20-a44b-7980e7109d45 admin admin] Resource SecurityGroupRule deleted: 2d190e70-7eb7-40fc-8442-310dbdfdde61 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:15:19.720519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4e25a16b-53c2-4e20-a44b-7980e7109d45 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (2d190e70-7eb7-40fc-8442-310dbdfdde61), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:19.720519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-4e25a16b-53c2-4e20-a44b-7980e7109d45 admin admin] Security group rule updated ['c53fb04d-0fc7-4cad-a436-6d3f475e2da4'] Sep 04 01:15:19.720519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4e25a16b-53c2-4e20-a44b-7980e7109d45 admin admin] Resource SecurityGroupRule deleted: 76a8fc5b-ad36-41c1-b0c3-f30778a38a45 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:15:19.720519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4e25a16b-53c2-4e20-a44b-7980e7109d45 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (76a8fc5b-ad36-41c1-b0c3-f30778a38a45), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:19.721061 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-4e25a16b-53c2-4e20-a44b-7980e7109d45 admin admin] Security group rule updated ['c53fb04d-0fc7-4cad-a436-6d3f475e2da4'] Sep 04 01:15:19.721061 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4e25a16b-53c2-4e20-a44b-7980e7109d45 admin admin] Resource SecurityGroupRule deleted: 988dd59e-523d-4405-88e3-6bf479ba4737 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:15:19.721061 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4e25a16b-53c2-4e20-a44b-7980e7109d45 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (988dd59e-523d-4405-88e3-6bf479ba4737), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:19.721061 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-4e25a16b-53c2-4e20-a44b-7980e7109d45 admin admin] Security group rule updated ['c53fb04d-0fc7-4cad-a436-6d3f475e2da4'] Sep 04 01:15:19.721061 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4e25a16b-53c2-4e20-a44b-7980e7109d45 admin admin] Resource SecurityGroupRule deleted: abea4b20-9f13-47bf-a5c2-466472bbbc1a {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:15:19.721498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4e25a16b-53c2-4e20-a44b-7980e7109d45 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (abea4b20-9f13-47bf-a5c2-466472bbbc1a), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:19.721498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-4e25a16b-53c2-4e20-a44b-7980e7109d45 admin admin] Security group rule updated ['c53fb04d-0fc7-4cad-a436-6d3f475e2da4'] Sep 04 01:15:20.571041 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:555 started Sep 04 01:15:20.573711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade57f5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=965000000,duration_sec=1129,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:15:20.574301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:15:20.574633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:555 - starting polling. Elapsed:0.004 Sep 04 01:15:20.576998 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:20.580581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:555 - port information retrieved. Elapsed:0.010 Sep 04 01:15:20.580934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:555 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Sep 04 01:15:20.669860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Resource Port 8ad76ee4-45f9-4f07-93dd-75ebf95bbe32 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:15:20.670240 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (8ad76ee4-45f9-4f07-93dd-75ebf95bbe32), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:21.703753 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-684b0325-02ca-4ecb-a3d0-18aed4583446 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-04T01:15:21Z,description='Default security group',id=52a8a1c7-0c01-462f-8efc-d70876921abe,is_default=True,name='default',project_id='83bd5ff9f21f4913b2848324640531e2',revision_number=1,rules=[SecurityGroupRule(193afe34-3073-47ad-b5ef-b2c4af69bdd5),SecurityGroupRule(1bec889d-fbf0-419e-9d8b-7fddb3432454),SecurityGroupRule(4bbea5ca-e39e-4ff3-a99d-c6edcf0844de),SecurityGroupRule(5fde4f28-25bb-4890-bd42-911b6b06a27a)],shared=False,stateful=True,updated_at=2022-09-04T01:15:21Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:15:21.704448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-684b0325-02ca-4ecb-a3d0-18aed4583446 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-68330'] for SecurityGroup (52a8a1c7-0c01-462f-8efc-d70876921abe), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:21.704853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-684b0325-02ca-4ecb-a3d0-18aed4583446 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:15:21Z,description=,direction='ingress',ethertype='IPv6',id=193afe34-3073-47ad-b5ef-b2c4af69bdd5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='83bd5ff9f21f4913b2848324640531e2',protocol=,remote_address_group_id=,remote_group_id=52a8a1c7-0c01-462f-8efc-d70876921abe,remote_ip_prefix=,revision_number=0,security_group_id=52a8a1c7-0c01-462f-8efc-d70876921abe,updated_at=2022-09-04T01:15:21Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:15:21.705265 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-684b0325-02ca-4ecb-a3d0-18aed4583446 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (193afe34-3073-47ad-b5ef-b2c4af69bdd5), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:21.708072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-684b0325-02ca-4ecb-a3d0-18aed4583446 admin admin] Security group rule updated ['52a8a1c7-0c01-462f-8efc-d70876921abe'] Sep 04 01:15:21.708072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-684b0325-02ca-4ecb-a3d0-18aed4583446 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:15:21Z,description=,direction='egress',ethertype='IPv4',id=1bec889d-fbf0-419e-9d8b-7fddb3432454,normalized_cidr=None,port_range_max=,port_range_min=,project_id='83bd5ff9f21f4913b2848324640531e2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=52a8a1c7-0c01-462f-8efc-d70876921abe,updated_at=2022-09-04T01:15:21Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:15:21.708072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-684b0325-02ca-4ecb-a3d0-18aed4583446 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (1bec889d-fbf0-419e-9d8b-7fddb3432454), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:21.708072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-684b0325-02ca-4ecb-a3d0-18aed4583446 admin admin] Security group rule updated ['52a8a1c7-0c01-462f-8efc-d70876921abe'] Sep 04 01:15:21.708428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-684b0325-02ca-4ecb-a3d0-18aed4583446 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:15:21Z,description=,direction='ingress',ethertype='IPv4',id=4bbea5ca-e39e-4ff3-a99d-c6edcf0844de,normalized_cidr=None,port_range_max=,port_range_min=,project_id='83bd5ff9f21f4913b2848324640531e2',protocol=,remote_address_group_id=,remote_group_id=52a8a1c7-0c01-462f-8efc-d70876921abe,remote_ip_prefix=,revision_number=0,security_group_id=52a8a1c7-0c01-462f-8efc-d70876921abe,updated_at=2022-09-04T01:15:21Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:15:21.708428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-684b0325-02ca-4ecb-a3d0-18aed4583446 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (4bbea5ca-e39e-4ff3-a99d-c6edcf0844de), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:21.708428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-684b0325-02ca-4ecb-a3d0-18aed4583446 admin admin] Security group rule updated ['52a8a1c7-0c01-462f-8efc-d70876921abe'] Sep 04 01:15:21.709147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-684b0325-02ca-4ecb-a3d0-18aed4583446 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-04T01:15:21Z,description=,direction='egress',ethertype='IPv6',id=5fde4f28-25bb-4890-bd42-911b6b06a27a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='83bd5ff9f21f4913b2848324640531e2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=52a8a1c7-0c01-462f-8efc-d70876921abe,updated_at=2022-09-04T01:15:21Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:15:21.709495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-684b0325-02ca-4ecb-a3d0-18aed4583446 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-67593'] for SecurityGroupRule (5fde4f28-25bb-4890-bd42-911b6b06a27a), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:21.709815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-684b0325-02ca-4ecb-a3d0-18aed4583446 admin admin] Security group rule updated ['52a8a1c7-0c01-462f-8efc-d70876921abe'] Sep 04 01:15:21.925898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-13ff722b-3c5b-4f7b-b46b-e94c2114c1f5 admin admin] Resource SecurityGroup deleted: 52a8a1c7-0c01-462f-8efc-d70876921abe {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:15:21.926515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-13ff722b-3c5b-4f7b-b46b-e94c2114c1f5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (52a8a1c7-0c01-462f-8efc-d70876921abe), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:21.927694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13ff722b-3c5b-4f7b-b46b-e94c2114c1f5 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('52a8a1c7-0c01-462f-8efc-d70876921abe',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:15:21.949601 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-13ff722b-3c5b-4f7b-b46b-e94c2114c1f5 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('52a8a1c7-0c01-462f-8efc-d70876921abe',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:15:21.950651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-13ff722b-3c5b-4f7b-b46b-e94c2114c1f5 admin admin] Resource SecurityGroupRule deleted: 193afe34-3073-47ad-b5ef-b2c4af69bdd5 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:15:21.954860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-13ff722b-3c5b-4f7b-b46b-e94c2114c1f5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (193afe34-3073-47ad-b5ef-b2c4af69bdd5), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:21.954860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-13ff722b-3c5b-4f7b-b46b-e94c2114c1f5 admin admin] Security group rule updated ['52a8a1c7-0c01-462f-8efc-d70876921abe'] Sep 04 01:15:21.954860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-13ff722b-3c5b-4f7b-b46b-e94c2114c1f5 admin admin] Resource SecurityGroupRule deleted: 1bec889d-fbf0-419e-9d8b-7fddb3432454 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:15:21.954860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-13ff722b-3c5b-4f7b-b46b-e94c2114c1f5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (1bec889d-fbf0-419e-9d8b-7fddb3432454), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:21.954860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-13ff722b-3c5b-4f7b-b46b-e94c2114c1f5 admin admin] Security group rule updated ['52a8a1c7-0c01-462f-8efc-d70876921abe'] Sep 04 01:15:21.955761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-13ff722b-3c5b-4f7b-b46b-e94c2114c1f5 admin admin] Resource SecurityGroupRule deleted: 4bbea5ca-e39e-4ff3-a99d-c6edcf0844de {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:15:21.956138 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-13ff722b-3c5b-4f7b-b46b-e94c2114c1f5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (4bbea5ca-e39e-4ff3-a99d-c6edcf0844de), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:21.956471 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-13ff722b-3c5b-4f7b-b46b-e94c2114c1f5 admin admin] Security group rule updated ['52a8a1c7-0c01-462f-8efc-d70876921abe'] Sep 04 01:15:21.957154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-13ff722b-3c5b-4f7b-b46b-e94c2114c1f5 admin admin] Resource SecurityGroupRule deleted: 5fde4f28-25bb-4890-bd42-911b6b06a27a {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:15:21.957507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-13ff722b-3c5b-4f7b-b46b-e94c2114c1f5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (5fde4f28-25bb-4890-bd42-911b6b06a27a), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:21.957830 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-13ff722b-3c5b-4f7b-b46b-e94c2114c1f5 admin admin] Security group rule updated ['52a8a1c7-0c01-462f-8efc-d70876921abe'] Sep 04 01:15:22.571588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:556 started Sep 04 01:15:22.574181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade57f7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=966000000,duration_sec=1131,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:15:22.576935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:15:22.576935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:556 - starting polling. Elapsed:0.004 Sep 04 01:15:22.577443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:22.581115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:556 - port information retrieved. Elapsed:0.010 Sep 04 01:15:22.581445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:556 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Sep 04 01:15:24.572329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:557 started Sep 04 01:15:24.575159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade57f9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=967000000,duration_sec=1133,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:15:24.575805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:15:24.576352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:557 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:15:24.584937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-904db60f-c0f0-4a28-b4b9-7a9fcb6bc8bd tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:15:23Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=94af0c51-d74e-4c78-9466-ecd1c16abdc2,mac_address=fa:16:3e:06:b7:7f,name='',network_id=e8e0564a-d5c9-4fe0-b2d4-538f45096708,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(94af0c51-d74e-4c78-9466-ecd1c16abdc2),security_group_ids=set([]),status='N/A',updated_at=2022-09-04T01:15:23Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:15:24.585360 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-904db60f-c0f0-4a28-b4b9-7a9fcb6bc8bd tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (94af0c51-d74e-4c78-9466-ecd1c16abdc2), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:25.309058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-904db60f-c0f0-4a28-b4b9-7a9fcb6bc8bd tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Resource Port 94af0c51-d74e-4c78-9466-ecd1c16abdc2 updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': '88634629-d485-4244-bba9-c4f7c60b82c7'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:15:25.309464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-904db60f-c0f0-4a28-b4b9-7a9fcb6bc8bd tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (94af0c51-d74e-4c78-9466-ecd1c16abdc2), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:26.573612 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:558 started Sep 04 01:15:26.576592 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade57fb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=968000000,duration_sec=1135,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:15:26.577383 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:15:26.577717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:558 - starting polling. Elapsed:0.004 Sep 04 01:15:26.580016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:15:26.583022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:558 - port information retrieved. Elapsed:0.010 Sep 04 01:15:26.583345 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:558 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Sep 04 01:15:28.575193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:559 started Sep 04 01:15:28.577598 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade57fd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=969000000,duration_sec=1137,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:15:28.578160 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:15:28.578509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:559 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:15:30.576200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:560 started Sep 04 01:15:30.578941 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade57ff,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=970000000,duration_sec=1139,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:15:30.580109 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:15:30.580453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:560 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:15:32.577136 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:561 started Sep 04 01:15:32.579906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5801,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=971000000,duration_sec=1141,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:15:32.580469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:15:32.580816 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:561 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:15:34.578427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:562 started Sep 04 01:15:34.581281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5803,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=973000000,duration_sec=1143,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:15:34.581831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:15:34.582174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:562 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:15:36.579555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:563 started Sep 04 01:15:36.581984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5805,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=974000000,duration_sec=1145,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:15:36.582540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:15:36.583409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:563 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:15:38.581168 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:564 started Sep 04 01:15:38.584464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5807,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=975000000,duration_sec=1147,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:15:38.585024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:15:38.585399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:564 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:15:40.582192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:565 started Sep 04 01:15:40.585421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5809,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=976000000,duration_sec=1149,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:15:40.586027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:15:40.586406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:565 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:15:42.583650 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:566 started Sep 04 01:15:42.586515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade580b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=978000000,duration_sec=1151,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:15:42.587085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:15:42.587432 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:566 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:15:44.584088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:567 started Sep 04 01:15:44.586577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade580d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=978000000,duration_sec=1153,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:15:44.587137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:15:44.587483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:567 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:15:46.585154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:568 started Sep 04 01:15:46.588456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade580f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=980000000,duration_sec=1155,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:15:46.589093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:15:46.589525 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:568 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 04 01:15:48.585963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:569 started Sep 04 01:15:48.588534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5811,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=980000000,duration_sec=1157,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:15:48.589101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:15:48.589460 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:569 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:15:50.586660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:570 started Sep 04 01:15:50.589040 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5813,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=981000000,duration_sec=1159,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:15:50.589660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:15:50.590007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:570 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:15:52.587586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:571 started Sep 04 01:15:52.590094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5815,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=982000000,duration_sec=1161,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:15:52.590649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:15:52.590997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:571 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:15:54.588214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:572 started Sep 04 01:15:54.590618 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5817,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=982000000,duration_sec=1163,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:15:54.591179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:15:54.591528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:572 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:15:56.589442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:573 started Sep 04 01:15:56.593165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5819,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=983000000,duration_sec=1165,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:15:56.593165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:15:56.593165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:573 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:15:58.590560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:574 started Sep 04 01:15:58.593135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade581b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=985000000,duration_sec=1167,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:15:58.593836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:15:58.594183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:574 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:16:00.591484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:575 started Sep 04 01:16:00.593864 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade581d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=985000000,duration_sec=1169,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:16:00.594438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:16:00.594783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:575 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:16:02.592601 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:576 started Sep 04 01:16:02.595024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade581f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=987000000,duration_sec=1171,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:16:02.595576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:16:02.595924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:576 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:16:04.593677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:577 started Sep 04 01:16:04.596601 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5821,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=988000000,duration_sec=1173,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:16:04.597208 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:16:04.597597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:577 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:16:06.594397 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:578 started Sep 04 01:16:06.596770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5823,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=988000000,duration_sec=1175,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:16:06.597357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:16:06.597703 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:578 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:16:08.594967 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:579 started Sep 04 01:16:08.597423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5825,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=989000000,duration_sec=1177,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:16:08.598004 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:16:08.598349 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:579 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:16:10.596270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:580 started Sep 04 01:16:10.598741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5827,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=990000000,duration_sec=1179,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:16:10.599302 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:16:10.599649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:580 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:16:12.597663 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:581 started Sep 04 01:16:12.600159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5829,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=992000000,duration_sec=1181,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:16:12.600721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:16:12.601069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:581 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:16:14.598398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:582 started Sep 04 01:16:14.600753 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade582b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=992000000,duration_sec=1183,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:16:14.601334 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:16:14.601680 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:582 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:16:16.599135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:583 started Sep 04 01:16:16.601585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade582d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=993000000,duration_sec=1185,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:16:16.602151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:16:16.602503 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:583 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:16:18.599722 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:584 started Sep 04 01:16:18.602079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade582f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=994000000,duration_sec=1187,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:16:18.602668 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:16:18.603066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:584 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:16:20.600897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:585 started Sep 04 01:16:20.603451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5831,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=995000000,duration_sec=1189,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:16:20.604014 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:16:20.604363 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:585 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:16:22.601896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:586 started Sep 04 01:16:22.604269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5833,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=996000000,duration_sec=1191,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:16:22.604901 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:16:22.605273 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:586 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:16:24.603422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:587 started Sep 04 01:16:24.605781 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5835,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=997000000,duration_sec=1193,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:16:24.606337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:16:24.606676 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:587 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:16:26.604023 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:588 started Sep 04 01:16:26.606422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5837,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=998000000,duration_sec=1195,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:16:26.607003 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:16:26.607345 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:588 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:16:28.605414 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:589 started Sep 04 01:16:28.607752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5839,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=999000000,duration_sec=1197,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:16:28.608311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:16:28.608662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:589 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:16:30.535672 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-a995195c-67e5-454b-b40d-522e4746ad8a tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Resource Port 17937f22-477f-47ec-b6b4-0ea96fee6512 updated (revision_number 6->7). Old fields: {'security_group_ids': CoercedSet({'76caf30c-8da1-44c1-bbaa-626b44c17c1d', '453a92ae-fa58-40a9-8940-f7ae3987450a'})} New fields: {'security_group_ids': CoercedSet({'76caf30c-8da1-44c1-bbaa-626b44c17c1d'})} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:16:30.537040 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-a995195c-67e5-454b-b40d-522e4746ad8a tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (17937f22-477f-47ec-b6b4-0ea96fee6512), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:16:30.538450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-a995195c-67e5-454b-b40d-522e4746ad8a tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Security group member updated {'76caf30c-8da1-44c1-bbaa-626b44c17c1d', '453a92ae-fa58-40a9-8940-f7ae3987450a'} Sep 04 01:16:30.605570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:590 started Sep 04 01:16:30.608011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade583b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=0,duration_sec=1200,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:16:30.608510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:16:30.608846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:590 - starting polling. Elapsed:0.003 Sep 04 01:16:30.611152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:16:30.614190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:590 - port information retrieved. Elapsed:0.009 Sep 04 01:16:30.614539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:590 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 04 01:16:30.726671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-314c305a-e8b8-4c10-859d-c6ce3ef190b1 tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Resource SecurityGroup deleted: 453a92ae-fa58-40a9-8940-f7ae3987450a {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:16:30.726671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-314c305a-e8b8-4c10-859d-c6ce3ef190b1 tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (453a92ae-fa58-40a9-8940-f7ae3987450a), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:16:30.726671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-314c305a-e8b8-4c10-859d-c6ce3ef190b1 tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('453a92ae-fa58-40a9-8940-f7ae3987450a',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:16:30.757010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-314c305a-e8b8-4c10-859d-c6ce3ef190b1 tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('453a92ae-fa58-40a9-8940-f7ae3987450a',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:16:30.757534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-314c305a-e8b8-4c10-859d-c6ce3ef190b1 tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Resource SecurityGroupRule deleted: 15d8f5bb-02e7-4f3f-a98c-bb86a1c57096 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:16:30.758103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-314c305a-e8b8-4c10-859d-c6ce3ef190b1 tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (15d8f5bb-02e7-4f3f-a98c-bb86a1c57096), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:16:30.758444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-314c305a-e8b8-4c10-859d-c6ce3ef190b1 tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Security group rule updated ['453a92ae-fa58-40a9-8940-f7ae3987450a'] Sep 04 01:16:30.759548 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-314c305a-e8b8-4c10-859d-c6ce3ef190b1 tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Resource SecurityGroupRule deleted: 7e1b3ca0-b19e-4d71-b80a-48736a1fa340 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:16:30.760184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-314c305a-e8b8-4c10-859d-c6ce3ef190b1 tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (7e1b3ca0-b19e-4d71-b80a-48736a1fa340), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:16:30.760512 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-314c305a-e8b8-4c10-859d-c6ce3ef190b1 tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Security group rule updated ['453a92ae-fa58-40a9-8940-f7ae3987450a'] Sep 04 01:16:30.761055 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-314c305a-e8b8-4c10-859d-c6ce3ef190b1 tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Resource SecurityGroupRule deleted: bdf15ac6-c80b-46cf-81b8-693e71b7cba6 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:16:30.761442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-314c305a-e8b8-4c10-859d-c6ce3ef190b1 tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (bdf15ac6-c80b-46cf-81b8-693e71b7cba6), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:16:30.761834 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-314c305a-e8b8-4c10-859d-c6ce3ef190b1 tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Security group rule updated ['453a92ae-fa58-40a9-8940-f7ae3987450a'] Sep 04 01:16:30.762284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-314c305a-e8b8-4c10-859d-c6ce3ef190b1 tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Resource SecurityGroupRule deleted: ebd13a01-f1c0-4f18-82c6-a8bb2ec41b62 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:16:30.762622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-314c305a-e8b8-4c10-859d-c6ce3ef190b1 tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (ebd13a01-f1c0-4f18-82c6-a8bb2ec41b62), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:16:30.762931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-314c305a-e8b8-4c10-859d-c6ce3ef190b1 tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Security group rule updated ['453a92ae-fa58-40a9-8940-f7ae3987450a'] Sep 04 01:16:30.763509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-314c305a-e8b8-4c10-859d-c6ce3ef190b1 tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Resource SecurityGroupRule deleted: 80ee7d29-9727-4416-9f56-ede8e8f2ae9d {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:16:30.763879 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-314c305a-e8b8-4c10-859d-c6ce3ef190b1 tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (80ee7d29-9727-4416-9f56-ede8e8f2ae9d), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:16:30.764194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-314c305a-e8b8-4c10-859d-c6ce3ef190b1 tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Security group rule updated ['453a92ae-fa58-40a9-8940-f7ae3987450a'] Sep 04 01:16:30.764604 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-314c305a-e8b8-4c10-859d-c6ce3ef190b1 tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Resource SecurityGroupRule deleted: e4f724e4-617d-4d52-b840-fad04c7e455d {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:16:30.764942 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-314c305a-e8b8-4c10-859d-c6ce3ef190b1 tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (e4f724e4-617d-4d52-b840-fad04c7e455d), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:16:30.765307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-314c305a-e8b8-4c10-859d-c6ce3ef190b1 tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Security group rule updated ['453a92ae-fa58-40a9-8940-f7ae3987450a'] Sep 04 01:16:30.765904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-314c305a-e8b8-4c10-859d-c6ce3ef190b1 tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Resource SecurityGroupRule deleted: 3eb8b7cb-426b-4754-95bb-ff8e9e2757e0 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:16:30.766247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-314c305a-e8b8-4c10-859d-c6ce3ef190b1 tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (3eb8b7cb-426b-4754-95bb-ff8e9e2757e0), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:16:30.766560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-314c305a-e8b8-4c10-859d-c6ce3ef190b1 tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Security group rule updated ['453a92ae-fa58-40a9-8940-f7ae3987450a'] Sep 04 01:16:30.766969 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-314c305a-e8b8-4c10-859d-c6ce3ef190b1 tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Resource SecurityGroupRule deleted: 84d006c8-de01-441c-b81e-9095178cca26 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:16:30.767301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-314c305a-e8b8-4c10-859d-c6ce3ef190b1 tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (84d006c8-de01-441c-b81e-9095178cca26), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:16:30.767611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-314c305a-e8b8-4c10-859d-c6ce3ef190b1 tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Security group rule updated ['453a92ae-fa58-40a9-8940-f7ae3987450a'] Sep 04 01:16:31.524273 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-ce782fca-9951-4026-941d-e4c61e8b20ae tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Resource Port deleted: 5ec2f0e6-c451-4062-8e28-4836b8b578a1 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:16:31.525210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-ce782fca-9951-4026-941d-e4c61e8b20ae tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (5ec2f0e6-c451-4062-8e28-4836b8b578a1), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:16:32.606522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:591 started Sep 04 01:16:32.612649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade583d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=1000000,duration_sec=1202,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:16:32.612649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:16:32.612649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:591 - starting polling. Elapsed:0.004 Sep 04 01:16:32.612649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:16:32.614629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 5ec2f0e6-c451-4062-8e28-4836b8b578a1 not present in bridge br-int Sep 04 01:16:32.614975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] net_uuid None not managed by VLAN manager Sep 04 01:16:32.615254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for ['5ec2f0e6-c451-4062-8e28-4836b8b578a1'] Sep 04 01:16:32.615772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 5ec2f0e6-c451-4062-8e28-4836b8b578a1 is not handled by the firewall. {{(pid=107812) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 04 01:16:32.619079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:591 - port information retrieved. Elapsed:0.013 Sep 04 01:16:32.619573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:591 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Sep 04 01:16:34.607830 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:592 started Sep 04 01:16:34.610296 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade583f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=2000000,duration_sec=1204,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:16:34.610860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:16:34.611209 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:592 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:16:36.608844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:593 started Sep 04 01:16:36.611240 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5841,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=3000000,duration_sec=1206,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:16:36.611781 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:16:36.612128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:593 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:16:38.610153 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:594 started Sep 04 01:16:38.612554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5843,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=4000000,duration_sec=1208,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:16:38.613164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:16:38.613512 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:594 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:16:38.627761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-99ae7e8e-951e-4fb1-9843-4f9c58d95162 tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Resource Port deleted: 17937f22-477f-47ec-b6b4-0ea96fee6512 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:16:38.629632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-99ae7e8e-951e-4fb1-9843-4f9c58d95162 tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (17937f22-477f-47ec-b6b4-0ea96fee6512), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:16:38.629632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-99ae7e8e-951e-4fb1-9843-4f9c58d95162 tempest-TestMinimumBasicScenario-391848128 tempest-TestMinimumBasicScenario-391848128-project] Security group member updated {'76caf30c-8da1-44c1-bbaa-626b44c17c1d'} Sep 04 01:16:40.611435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:595 started Sep 04 01:16:40.614800 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5845,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=5000000,duration_sec=1210,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:16:40.615360 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:16:40.615688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:595 - starting polling. Elapsed:0.004 Sep 04 01:16:40.618127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:16:40.620247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 17937f22-477f-47ec-b6b4-0ea96fee6512 not present in bridge br-int Sep 04 01:16:40.620946 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] net_uuid None not managed by VLAN manager Sep 04 01:16:40.621173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for ['17937f22-477f-47ec-b6b4-0ea96fee6512'] Sep 04 01:16:40.621430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 17937f22-477f-47ec-b6b4-0ea96fee6512 is not handled by the firewall. {{(pid=107812) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 04 01:16:40.624483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:595 - port information retrieved. Elapsed:0.013 Sep 04 01:16:40.624822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:595 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.014 Sep 04 01:16:41.924405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-af00d4ca-74da-450c-b40c-abd255932778 admin admin] Resource Port deleted: 7f2856e4-8bb1-4647-8890-edd403bce7d0 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:16:41.925155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-af00d4ca-74da-450c-b40c-abd255932778 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (7f2856e4-8bb1-4647-8890-edd403bce7d0), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:16:42.612846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:596 started Sep 04 01:16:42.615429 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5847,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=7000000,duration_sec=1212,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:16:42.616015 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:16:42.616417 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:596 - starting polling. Elapsed:0.004 Sep 04 01:16:42.619453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:16:42.623218 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-7f2856e4-8b, col_values=(('tag', 4095),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:16:42.631232 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade5849,OFPFlowMod(buffer_id=4294967295,command=0,cookie=6887031442322345889,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 28}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:16:42.631900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for ['7f2856e4-8bb1-4647-8890-edd403bce7d0'] Sep 04 01:16:42.632523 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 4 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:16:42.672161 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[a659ca28-3831-4454-86dd-df46d5038003]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:16:42.675851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:596 - port information retrieved. Elapsed:0.063 Sep 04 01:16:42.676305 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:596 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.063 Sep 04 01:16:42.907268 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["2f7b6bf9-84bb-4239-b6e7-cad03019618b","delete","qr-7f2856e4-8b",28,["map",[["attached-mac","fa:16:3e:29:5f:f3"],["iface-id","7f2856e4-8bb1-4647-8890-edd403bce7d0"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:16:43.051978 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-2f8a3f47-6db2-4906-bf16-6004c58c8a15 admin admin] Resource Port deleted: e7120691-3bea-4fb5-9cd0-62e18c24380d {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:16:43.052609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-2f8a3f47-6db2-4906-bf16-6004c58c8a15 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (e7120691-3bea-4fb5-9cd0-62e18c24380d), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:16:43.294786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["5a58ad02-b9fc-435a-9759-c6e11e6e11cd","delete","qg-e7120691-3b",29,["map",[["attached-mac","fa:16:3e:f7:3f:6e"],["iface-id","e7120691-3bea-4fb5-9cd0-62e18c24380d"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:16:43.729169 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-35d31b50-6bb8-461a-a159-f51921bcfdc7 admin admin] Resource Subnet deleted: 231765c8-800c-4149-b414-9dbe7bc03304 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:16:43.729916 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-35d31b50-6bb8-461a-a159-f51921bcfdc7 admin admin] Publish callbacks [] for Subnet (231765c8-800c-4149-b414-9dbe7bc03304), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:16:43.867500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["08226bc2-98a5-4b5f-b2cb-50abb5430cd2","delete","tap5f5b2b5c-f8",27,["map",[["attached-mac","fa:16:3e:e3:22:a0"],["iface-id","5f5b2b5c-f8bd-4ca8-94f2-f4d5e3a6444d"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:16:44.140918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-a77cba2e-3960-412b-a9b3-ec01e28736bb admin admin] Resource Port deleted: 5f5b2b5c-f8bd-4ca8-94f2-f4d5e3a6444d {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:16:44.142405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-a77cba2e-3960-412b-a9b3-ec01e28736bb admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (5f5b2b5c-f8bd-4ca8-94f2-f4d5e3a6444d), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:16:44.154224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-8543356a-224a-422f-96bc-1da18509e174 None None] Resource Port deleted: 5f5b2b5c-f8bd-4ca8-94f2-f4d5e3a6444d {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:16:44.154669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-8543356a-224a-422f-96bc-1da18509e174 None None] Skipped duplicate delete event for 5f5b2b5c-f8bd-4ca8-94f2-f4d5e3a6444d {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:209}} Sep 04 01:16:44.424439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-a77cba2e-3960-412b-a9b3-ec01e28736bb admin admin] Resource Network deleted: 93fca803-def7-462d-b519-0eb07f4ac511 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:16:44.424904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-a77cba2e-3960-412b-a9b3-ec01e28736bb admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533'] for Network (93fca803-def7-462d-b519-0eb07f4ac511), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:16:44.613479 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:597 started Sep 04 01:16:44.615886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade584b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=7000000,duration_sec=1214,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:16:44.616514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:16:44.617031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:597 - starting polling. Elapsed:0.004 Sep 04 01:16:44.619361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:16:44.623912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade584d,OFPFlowMod(buffer_id=4294967295,command=3,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 27}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:16:44.625888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade584f,OFPFlowMod(buffer_id=4294967295,command=3,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 28}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:16:44.627659 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade5851,OFPFlowMod(buffer_id=4294967295,command=3,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 29}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:16:44.627997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:597 - port information retrieved. Elapsed:0.015 Sep 04 01:16:44.628332 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Starting to process devices in:{'current': {'82064230-2100-4279-b030-003ad6dab6f1', 'cd34646e-9957-4ab9-b15e-f0afcfd59c3b', '491c36f8-0074-4f7c-870c-6d117c1f71b6', '20940f6e-c5ec-497b-b144-a180350e4857', 'c73d8972-0881-4e30-8303-b09f2c82f2f0', '3fa24970-97a7-4f46-ac55-0b24323fa402', '2c3ac556-7316-478e-a2cf-0863e3b01f18', '89aa06b4-bbf1-40c2-bb48-500c3aecdf48', '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', '996205b2-4ccc-4913-8458-2e4f1e0e6687', '4e686822-d1bf-4795-baed-c36577dc9ff3', '7f8c6aaa-73de-4cf1-a59c-a00c8f32c2d8', 'ca102ce7-433c-4029-aabf-33d944165ff1'}, 'added': set(), 'removed': {'e7120691-3bea-4fb5-9cd0-62e18c24380d', '7f2856e4-8bb1-4647-8890-edd403bce7d0', '5f5b2b5c-f8bd-4ca8-94f2-f4d5e3a6444d'}, 'updated': set(), 're_added': set()} {{(pid=107812) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 04 01:16:44.628659 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:597 - agent port security group processed in 0.000 Sep 04 01:16:44.630467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Configuration for devices up [] and devices down [] completed. Sep 04 01:16:44.630774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for {'e7120691-3bea-4fb5-9cd0-62e18c24380d', '7f2856e4-8bb1-4647-8890-edd403bce7d0', '5f5b2b5c-f8bd-4ca8-94f2-f4d5e3a6444d'} Sep 04 01:16:44.631163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 7f2856e4-8bb1-4647-8890-edd403bce7d0 is not handled by the firewall. {{(pid=107812) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 04 01:16:44.631590 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 8 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:16:44.668985 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[e241205c-82c9-4d8c-9fa5-1c815f0be0ac]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:16:44.669521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Ports {'e7120691-3bea-4fb5-9cd0-62e18c24380d', '7f2856e4-8bb1-4647-8890-edd403bce7d0', '5f5b2b5c-f8bd-4ca8-94f2-f4d5e3a6444d'} removed Sep 04 01:16:44.741546 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port removal failed for set() {{(pid=107812) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 04 01:16:44.741992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] net_uuid None not managed by VLAN manager Sep 04 01:16:44.742359 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Reclaiming vlan = 11 from net-id = 93fca803-def7-462d-b519-0eb07f4ac511, seg-id = 189 Sep 04 01:16:44.745037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x1fd38c17,OFPFlowMod(buffer_id=4294967295,command=3,cookie=6561907047025962751,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4107}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:16:44.747730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xeade5853,OFPFlowMod(buffer_id=4294967295,command=3,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4285}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:16:44.748047 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:597 - treat_devices_removed completed in 0.117 Sep 04 01:16:44.748334 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:597 - ports processed. Elapsed:0.135 Sep 04 01:16:44.748663 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:597 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 3}}. Elapsed:0.135 Sep 04 01:16:45.339112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-ef187d27-6547-4623-a4d3-3978a5e23260 admin admin] Resource Port deleted: 7f8c6aaa-73de-4cf1-a59c-a00c8f32c2d8 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:16:45.339756 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-ef187d27-6547-4623-a4d3-3978a5e23260 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (7f8c6aaa-73de-4cf1-a59c-a00c8f32c2d8), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:16:46.458391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["25fcb871-7014-4f1b-9a58-538223dc3e47","delete","qr-7f8c6aaa-73",32,["map",[["attached-mac","fa:16:3e:3f:00:e0"],["iface-id","7f8c6aaa-73de-4cf1-a59c-a00c8f32c2d8"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:16:46.505499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-fa495fca-a661-4a19-84de-da608d9efad9 admin admin] Resource Port deleted: 82064230-2100-4279-b030-003ad6dab6f1 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:16:46.508596 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-fa495fca-a661-4a19-84de-da608d9efad9 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (82064230-2100-4279-b030-003ad6dab6f1), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:16:46.614576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:598 started Sep 04 01:16:46.753197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5855,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=143000000,duration_sec=1216,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:16:46.753775 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:16:46.754197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:598 - starting polling. Elapsed:0.140 Sep 04 01:16:46.756105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:16:46.759021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-82064230-21, col_values=(('tag', 4095),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:16:46.778517 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade5857,OFPFlowMod(buffer_id=4294967295,command=0,cookie=6887031442322345889,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 31}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:16:46.779332 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for ['82064230-2100-4279-b030-003ad6dab6f1'] Sep 04 01:16:46.780052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 4 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:16:46.821207 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8eefce-7d2c-4d3e-89d4-2d08fc03ccf6]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:16:46.830218 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade5859,OFPFlowMod(buffer_id=4294967295,command=3,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 32}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:16:46.830673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:598 - port information retrieved. Elapsed:0.216 Sep 04 01:16:46.831089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Starting to process devices in:{'current': {'82064230-2100-4279-b030-003ad6dab6f1', 'cd34646e-9957-4ab9-b15e-f0afcfd59c3b', '491c36f8-0074-4f7c-870c-6d117c1f71b6', '20940f6e-c5ec-497b-b144-a180350e4857', 'c73d8972-0881-4e30-8303-b09f2c82f2f0', '3fa24970-97a7-4f46-ac55-0b24323fa402', '2c3ac556-7316-478e-a2cf-0863e3b01f18', '89aa06b4-bbf1-40c2-bb48-500c3aecdf48', '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', '996205b2-4ccc-4913-8458-2e4f1e0e6687', '4e686822-d1bf-4795-baed-c36577dc9ff3', 'ca102ce7-433c-4029-aabf-33d944165ff1'}, 'added': set(), 'removed': {'7f8c6aaa-73de-4cf1-a59c-a00c8f32c2d8'}, 'updated': set(), 're_added': set()} {{(pid=107812) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 04 01:16:46.831491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:598 - agent port security group processed in 0.000 Sep 04 01:16:46.833442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Configuration for devices up [] and devices down [] completed. Sep 04 01:16:46.833835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for {'7f8c6aaa-73de-4cf1-a59c-a00c8f32c2d8'} Sep 04 01:16:46.834383 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 4 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:16:46.856474 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["7c7a1753-ddbe-4485-8b6e-6f17ac4b5e2c","delete","qg-82064230-21",31,["map",[["attached-mac","fa:16:3e:a0:05:ba"],["iface-id","82064230-2100-4279-b030-003ad6dab6f1"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:16:47.076983 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-fe7129fe-ace4-494f-8c86-d4b4f7617fdc admin admin] Resource Subnet deleted: 41b00470-0fa1-4d8a-8c47-37a6136cdce6 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:16:47.077450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-fe7129fe-ace4-494f-8c86-d4b4f7617fdc admin admin] Publish callbacks [] for Subnet (41b00470-0fa1-4d8a-8c47-37a6136cdce6), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:16:47.157595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc2d839-bd5d-4d7e-9148-9c2d1c17d13e]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:16:47.158832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Ports {'7f8c6aaa-73de-4cf1-a59c-a00c8f32c2d8'} removed Sep 04 01:16:47.201597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port removal failed for set() {{(pid=107812) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 04 01:16:47.202375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:598 - treat_devices_removed completed in 0.369 Sep 04 01:16:47.202831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:598 - ports processed. Elapsed:0.588 Sep 04 01:16:47.203429 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:598 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 1}}. Elapsed:0.589 Sep 04 01:16:47.234495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["3e75b8c9-7a48-4459-9681-052a27aeef9e","delete","tapcd34646e-99",30,["map",[["attached-mac","fa:16:3e:1d:7d:67"],["iface-id","cd34646e-9957-4ab9-b15e-f0afcfd59c3b"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:16:47.500479 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-fc20da18-0d77-4832-a126-a6a33adbb73c admin admin] Resource Port deleted: cd34646e-9957-4ab9-b15e-f0afcfd59c3b {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:16:47.501678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-fc20da18-0d77-4832-a126-a6a33adbb73c admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (cd34646e-9957-4ab9-b15e-f0afcfd59c3b), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:16:47.513467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4de469ff-45e5-4db9-82d9-66c6db2abe6f None None] Resource Port deleted: cd34646e-9957-4ab9-b15e-f0afcfd59c3b {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:16:47.514100 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4de469ff-45e5-4db9-82d9-66c6db2abe6f None None] Skipped duplicate delete event for cd34646e-9957-4ab9-b15e-f0afcfd59c3b {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:209}} Sep 04 01:16:48.056740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-fc20da18-0d77-4832-a126-a6a33adbb73c admin admin] Resource Network deleted: dd0b2869-d6c7-4142-bc77-f5ba8b31cfeb {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:16:48.057444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-fc20da18-0d77-4832-a126-a6a33adbb73c admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533'] for Network (dd0b2869-d6c7-4142-bc77-f5ba8b31cfeb), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:16:48.615903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:599 started Sep 04 01:16:48.618468 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade585b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=10000000,duration_sec=1218,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:16:48.619032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:16:48.619477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:599 - starting polling. Elapsed:0.004 Sep 04 01:16:48.621525 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:16:48.625221 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade585d,OFPFlowMod(buffer_id=4294967295,command=3,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 30}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:16:48.626804 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade585f,OFPFlowMod(buffer_id=4294967295,command=3,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 31}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:16:48.627106 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:599 - port information retrieved. Elapsed:0.011 Sep 04 01:16:48.627428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Starting to process devices in:{'current': {'491c36f8-0074-4f7c-870c-6d117c1f71b6', '20940f6e-c5ec-497b-b144-a180350e4857', 'c73d8972-0881-4e30-8303-b09f2c82f2f0', '3fa24970-97a7-4f46-ac55-0b24323fa402', '2c3ac556-7316-478e-a2cf-0863e3b01f18', '89aa06b4-bbf1-40c2-bb48-500c3aecdf48', '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', '996205b2-4ccc-4913-8458-2e4f1e0e6687', '4e686822-d1bf-4795-baed-c36577dc9ff3', 'ca102ce7-433c-4029-aabf-33d944165ff1'}, 'added': set(), 'removed': {'82064230-2100-4279-b030-003ad6dab6f1', 'cd34646e-9957-4ab9-b15e-f0afcfd59c3b'}, 'updated': set(), 're_added': set()} {{(pid=107812) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 04 01:16:48.627745 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:599 - agent port security group processed in 0.000 Sep 04 01:16:48.629249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Configuration for devices up [] and devices down [] completed. Sep 04 01:16:48.629551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for {'82064230-2100-4279-b030-003ad6dab6f1', 'cd34646e-9957-4ab9-b15e-f0afcfd59c3b'} Sep 04 01:16:48.629874 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 82064230-2100-4279-b030-003ad6dab6f1 is not handled by the firewall. {{(pid=107812) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 04 01:16:48.630283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 4 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:16:48.653925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-908ee351-41da-4aa2-a9b3-08a2ae597dbb admin admin] Resource SecurityGroup deleted: 76caf30c-8da1-44c1-bbaa-626b44c17c1d {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:16:48.654304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-908ee351-41da-4aa2-a9b3-08a2ae597dbb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (76caf30c-8da1-44c1-bbaa-626b44c17c1d), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:16:48.654760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-908ee351-41da-4aa2-a9b3-08a2ae597dbb admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('76caf30c-8da1-44c1-bbaa-626b44c17c1d',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:16:48.670632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-908ee351-41da-4aa2-a9b3-08a2ae597dbb admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('76caf30c-8da1-44c1-bbaa-626b44c17c1d',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:16:48.671086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-908ee351-41da-4aa2-a9b3-08a2ae597dbb admin admin] Resource SecurityGroupRule deleted: 04c99dff-8057-4beb-923e-45c5b9100501 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:16:48.671457 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-908ee351-41da-4aa2-a9b3-08a2ae597dbb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (04c99dff-8057-4beb-923e-45c5b9100501), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:16:48.671788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-908ee351-41da-4aa2-a9b3-08a2ae597dbb admin admin] Security group rule updated ['76caf30c-8da1-44c1-bbaa-626b44c17c1d'] Sep 04 01:16:48.672219 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-908ee351-41da-4aa2-a9b3-08a2ae597dbb admin admin] Resource SecurityGroupRule deleted: b2ac7312-fba5-4a73-9f77-2e661f771820 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:16:48.672559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-908ee351-41da-4aa2-a9b3-08a2ae597dbb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (b2ac7312-fba5-4a73-9f77-2e661f771820), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:16:48.672875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-908ee351-41da-4aa2-a9b3-08a2ae597dbb admin admin] Security group rule updated ['76caf30c-8da1-44c1-bbaa-626b44c17c1d'] Sep 04 01:16:48.673310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-908ee351-41da-4aa2-a9b3-08a2ae597dbb admin admin] Resource SecurityGroupRule deleted: e31ed291-e631-4a00-bff9-1898ccc6da9b {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:16:48.673649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-908ee351-41da-4aa2-a9b3-08a2ae597dbb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (e31ed291-e631-4a00-bff9-1898ccc6da9b), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:16:48.673960 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-908ee351-41da-4aa2-a9b3-08a2ae597dbb admin admin] Security group rule updated ['76caf30c-8da1-44c1-bbaa-626b44c17c1d'] Sep 04 01:16:48.674370 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-908ee351-41da-4aa2-a9b3-08a2ae597dbb admin admin] Resource SecurityGroupRule deleted: e9fa14f9-ccc2-46e0-a8dc-217bc663cee3 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:16:48.674704 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-908ee351-41da-4aa2-a9b3-08a2ae597dbb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (e9fa14f9-ccc2-46e0-a8dc-217bc663cee3), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:16:48.675015 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-908ee351-41da-4aa2-a9b3-08a2ae597dbb admin admin] Security group rule updated ['76caf30c-8da1-44c1-bbaa-626b44c17c1d'] Sep 04 01:16:48.675620 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac2684f-c740-4060-a744-2838fb78ac5e]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:16:48.676780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Ports {'82064230-2100-4279-b030-003ad6dab6f1', 'cd34646e-9957-4ab9-b15e-f0afcfd59c3b'} removed Sep 04 01:16:48.727153 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port removal failed for set() {{(pid=107812) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 04 01:16:48.727578 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] net_uuid None not managed by VLAN manager Sep 04 01:16:48.728051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Reclaiming vlan = 12 from net-id = dd0b2869-d6c7-4142-bc77-f5ba8b31cfeb, seg-id = 190 Sep 04 01:16:48.730677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x1fd38c19,OFPFlowMod(buffer_id=4294967295,command=3,cookie=6561907047025962751,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4108}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:16:48.733517 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xeade5861,OFPFlowMod(buffer_id=4294967295,command=3,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4286}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:16:48.733884 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:599 - treat_devices_removed completed in 0.104 Sep 04 01:16:48.734193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:599 - ports processed. Elapsed:0.118 Sep 04 01:16:48.738679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:599 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 2}}. Elapsed:0.119 Sep 04 01:16:49.537733 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-84e6f5fa-3e3e-4085-9d22-29f71f9b7ce7 admin admin] Resource SecurityGroup deleted: fcffb30e-54bc-46bc-bcad-d2bb85743e24 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:16:49.538176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-84e6f5fa-3e3e-4085-9d22-29f71f9b7ce7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (fcffb30e-54bc-46bc-bcad-d2bb85743e24), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:16:49.538806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84e6f5fa-3e3e-4085-9d22-29f71f9b7ce7 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('fcffb30e-54bc-46bc-bcad-d2bb85743e24',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:16:49.555847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-84e6f5fa-3e3e-4085-9d22-29f71f9b7ce7 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('fcffb30e-54bc-46bc-bcad-d2bb85743e24',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:16:49.555847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-84e6f5fa-3e3e-4085-9d22-29f71f9b7ce7 admin admin] Resource SecurityGroupRule deleted: 14da2436-6c31-4861-9912-8996a23db711 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:16:49.555847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-84e6f5fa-3e3e-4085-9d22-29f71f9b7ce7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (14da2436-6c31-4861-9912-8996a23db711), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:16:49.555847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-84e6f5fa-3e3e-4085-9d22-29f71f9b7ce7 admin admin] Security group rule updated ['fcffb30e-54bc-46bc-bcad-d2bb85743e24'] Sep 04 01:16:49.555847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-84e6f5fa-3e3e-4085-9d22-29f71f9b7ce7 admin admin] Resource SecurityGroupRule deleted: 5379d381-bacb-44bd-8c82-54e5ec1264ea {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:16:49.556373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-84e6f5fa-3e3e-4085-9d22-29f71f9b7ce7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (5379d381-bacb-44bd-8c82-54e5ec1264ea), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:16:49.556373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-84e6f5fa-3e3e-4085-9d22-29f71f9b7ce7 admin admin] Security group rule updated ['fcffb30e-54bc-46bc-bcad-d2bb85743e24'] Sep 04 01:16:49.556373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-84e6f5fa-3e3e-4085-9d22-29f71f9b7ce7 admin admin] Resource SecurityGroupRule deleted: 7ea86ecb-6921-4368-95f1-d65be594baa7 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:16:49.556373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-84e6f5fa-3e3e-4085-9d22-29f71f9b7ce7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (7ea86ecb-6921-4368-95f1-d65be594baa7), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:16:49.556774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-84e6f5fa-3e3e-4085-9d22-29f71f9b7ce7 admin admin] Security group rule updated ['fcffb30e-54bc-46bc-bcad-d2bb85743e24'] Sep 04 01:16:49.557809 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-84e6f5fa-3e3e-4085-9d22-29f71f9b7ce7 admin admin] Resource SecurityGroupRule deleted: 8ad84c51-4f85-4266-89c5-c54e0d938467 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:16:49.558208 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-84e6f5fa-3e3e-4085-9d22-29f71f9b7ce7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (8ad84c51-4f85-4266-89c5-c54e0d938467), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:16:49.558547 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-84e6f5fa-3e3e-4085-9d22-29f71f9b7ce7 admin admin] Security group rule updated ['fcffb30e-54bc-46bc-bcad-d2bb85743e24'] Sep 04 01:16:50.617306 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:600 started Sep 04 01:16:50.620300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5863,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=11000000,duration_sec=1220,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:16:50.621148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:16:50.621504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:600 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:16:52.618603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:601 started Sep 04 01:16:52.621953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5865,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=13000000,duration_sec=1222,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:16:52.622572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:16:52.622924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:601 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:16:54.619959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:602 started Sep 04 01:16:54.627076 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5867,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=15000000,duration_sec=1224,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:16:54.628231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:16:54.628231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:602 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 04 01:16:56.620357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:603 started Sep 04 01:16:56.623227 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5869,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=15000000,duration_sec=1226,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:16:56.623795 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:16:56.624145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:603 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:16:58.621160 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:604 started Sep 04 01:16:58.624226 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade586b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=15000000,duration_sec=1228,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:16:58.624784 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:16:58.625182 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:604 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:17:00.621565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:605 started Sep 04 01:17:00.624433 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade586d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=16000000,duration_sec=1230,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:17:00.624965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:17:00.625340 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:605 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:17:02.622301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:606 started Sep 04 01:17:02.624664 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade586f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=16000000,duration_sec=1232,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:17:02.625248 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:17:02.625593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:606 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:17:04.623155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:607 started Sep 04 01:17:04.625519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5871,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=17000000,duration_sec=1234,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:17:04.626084 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:17:04.626445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:607 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:17:06.624265 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:608 started Sep 04 01:17:06.626710 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5873,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=18000000,duration_sec=1236,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:17:06.627296 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:17:06.627649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:608 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:17:08.625297 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:609 started Sep 04 01:17:08.627975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5875,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=20000000,duration_sec=1238,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:17:08.628550 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:17:08.628939 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:609 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:17:10.625762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:610 started Sep 04 01:17:10.628447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5877,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=20000000,duration_sec=1240,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:17:10.629000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:17:10.629373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:610 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:17:12.626801 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:611 started Sep 04 01:17:12.629221 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5879,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=21000000,duration_sec=1242,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:17:12.629805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:17:12.630170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:611 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:17:14.628182 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:612 started Sep 04 01:17:14.630585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade587b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=22000000,duration_sec=1244,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:17:14.631141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:17:14.631484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:612 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:17:16.629032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:613 started Sep 04 01:17:16.631455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade587d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=23000000,duration_sec=1246,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:17:16.632016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:17:16.632357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:613 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:17:18.629457 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:614 started Sep 04 01:17:18.631784 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade587f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=23000000,duration_sec=1248,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:17:18.632337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:17:18.632681 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:614 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:17:20.630750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:615 started Sep 04 01:17:20.633241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5881,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=25000000,duration_sec=1250,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:17:20.633800 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:17:20.634142 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:615 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:17:22.631972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:616 started Sep 04 01:17:22.634764 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5883,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=26000000,duration_sec=1252,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:17:22.635398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:17:22.635842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:616 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:17:23.789335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-8fa32494-5309-43e4-8eb6-c3ff992573d7 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Resource Port deleted: 8ad76ee4-45f9-4f07-93dd-75ebf95bbe32 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:17:23.789858 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-8fa32494-5309-43e4-8eb6-c3ff992573d7 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (8ad76ee4-45f9-4f07-93dd-75ebf95bbe32), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:17:23.790259 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-8fa32494-5309-43e4-8eb6-c3ff992573d7 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Security group member updated {'46402ba3-28d6-4a31-82e5-99b05a90c3c7'} Sep 04 01:17:24.633230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:617 started Sep 04 01:17:24.635652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5885,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=27000000,duration_sec=1254,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:17:24.636217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:17:24.636783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:617 - starting polling. Elapsed:0.004 Sep 04 01:17:24.638609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:17:24.639816 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 8ad76ee4-45f9-4f07-93dd-75ebf95bbe32 not present in bridge br-int Sep 04 01:17:24.640799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] net_uuid None not managed by VLAN manager Sep 04 01:17:24.641174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for ['8ad76ee4-45f9-4f07-93dd-75ebf95bbe32'] Sep 04 01:17:24.641502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 8ad76ee4-45f9-4f07-93dd-75ebf95bbe32 is not handled by the firewall. {{(pid=107812) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 04 01:17:24.643578 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:617 - port information retrieved. Elapsed:0.011 Sep 04 01:17:24.643935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:617 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 04 01:17:26.634362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:618 started Sep 04 01:17:26.636638 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5887,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=28000000,duration_sec=1256,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:17:26.637738 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:17:26.638081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:618 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:17:28.635084 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:619 started Sep 04 01:17:28.637468 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5889,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=29000000,duration_sec=1258,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:17:28.638076 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:17:28.638449 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:619 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:17:30.178068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-df00ea44-869a-48b0-8d8f-b94c69bd7037 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:17:29Z,data_plane_status=None,description='',device_id='77c3060f-d328-4221-864f-8af5a9baae4c',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=da467063-2304-41a7-80d8-d19cc5f69f7a,mac_address=fa:16:3e:44:79:ae,name='',network_id=ca88993b-9210-4173-b062-c40cdf9e1da6,numa_affinity_policy=,project_id='2506b96ac13541e6a7a47c5aedca67e5',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(da467063-2304-41a7-80d8-d19cc5f69f7a),security_group_ids=set([46402ba3-28d6-4a31-82e5-99b05a90c3c7]),status='DOWN',updated_at=2022-09-04T01:17:29Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:17:30.179426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-df00ea44-869a-48b0-8d8f-b94c69bd7037 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (da467063-2304-41a7-80d8-d19cc5f69f7a), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:17:30.180080 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-df00ea44-869a-48b0-8d8f-b94c69bd7037 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Security group member updated {'46402ba3-28d6-4a31-82e5-99b05a90c3c7'} Sep 04 01:17:30.635948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:620 started Sep 04 01:17:30.638403 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade588b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=30000000,duration_sec=1260,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:17:30.639183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:17:30.639665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:620 - starting polling. Elapsed:0.004 Sep 04 01:17:30.641757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:17:30.644088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:620 - port information retrieved. Elapsed:0.008 Sep 04 01:17:30.644428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:620 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 04 01:17:30.882637 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-cac49a76-8ec4-449b-b7ec-29e66c3cdad3 service neutron] Resource Port da467063-2304-41a7-80d8-d19cc5f69f7a updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=da467063-2304-41a7-80d8-d19cc5f69f7a,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=da467063-2304-41a7-80d8-d19cc5f69f7a,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:17:30.883019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-cac49a76-8ec4-449b-b7ec-29e66c3cdad3 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (da467063-2304-41a7-80d8-d19cc5f69f7a), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:17:31.122098 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-cac49a76-8ec4-449b-b7ec-29e66c3cdad3 service neutron] Resource Port da467063-2304-41a7-80d8-d19cc5f69f7a updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=da467063-2304-41a7-80d8-d19cc5f69f7a,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=da467063-2304-41a7-80d8-d19cc5f69f7a,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=da467063-2304-41a7-80d8-d19cc5f69f7a,segment=NetworkSegment(ec3b99f9-cd00-455f-aba9-a56f7e7f2980),segment_id=ec3b99f9-cd00-455f-aba9-a56f7e7f2980)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:17:31.126129 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-cac49a76-8ec4-449b-b7ec-29e66c3cdad3 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (da467063-2304-41a7-80d8-d19cc5f69f7a), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:17:32.636453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:621 started Sep 04 01:17:32.639422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade588d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=30000000,duration_sec=1262,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:17:32.640013 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:17:32.640878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:621 - starting polling. Elapsed:0.005 Sep 04 01:17:32.642672 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:17:32.644823 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:621 - port information retrieved. Elapsed:0.009 Sep 04 01:17:32.645191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:621 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 04 01:17:34.637847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:622 started Sep 04 01:17:34.640777 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade588f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=32000000,duration_sec=1264,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:17:34.641405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:17:34.641753 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:622 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:17:36.638938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:623 started Sep 04 01:17:36.642183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5891,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=33000000,duration_sec=1266,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:17:36.642854 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:17:36.643210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:623 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:17:38.640836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:624 started Sep 04 01:17:38.643251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5893,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=35000000,duration_sec=1268,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:17:38.643838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:17:38.644186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:624 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:17:39.292498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Resource Port da467063-2304-41a7-80d8-d19cc5f69f7a updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:17:39.292912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (da467063-2304-41a7-80d8-d19cc5f69f7a), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:17:40.641146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:625 started Sep 04 01:17:40.643551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5895,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=35000000,duration_sec=1270,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:17:40.644147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:17:40.644480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:625 - starting polling. Elapsed:0.004 Sep 04 01:17:40.646272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:17:40.648450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:625 - port information retrieved. Elapsed:0.008 Sep 04 01:17:40.648783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:625 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 04 01:17:41.356886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Resource Port da467063-2304-41a7-80d8-d19cc5f69f7a updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:17:41.357281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (da467063-2304-41a7-80d8-d19cc5f69f7a), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:17:42.641937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:626 started Sep 04 01:17:42.644308 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5897,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=36000000,duration_sec=1272,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:17:42.644868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:17:42.645232 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:626 - starting polling. Elapsed:0.004 Sep 04 01:17:42.646953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:17:42.649155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:626 - port information retrieved. Elapsed:0.007 Sep 04 01:17:42.649484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:626 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 04 01:17:44.511111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c44e915c-22d4-47a1-b68f-039067803235 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:17:44Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=5ee2ac7f-a0bd-48ec-87f1-756163b9c8c9,mac_address=fa:16:3e:96:9d:79,name='',network_id=e8e0564a-d5c9-4fe0-b2d4-538f45096708,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(5ee2ac7f-a0bd-48ec-87f1-756163b9c8c9),security_group_ids=set([]),status='N/A',updated_at=2022-09-04T01:17:44Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:17:44.511764 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-c44e915c-22d4-47a1-b68f-039067803235 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (5ee2ac7f-a0bd-48ec-87f1-756163b9c8c9), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:17:44.642781 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:627 started Sep 04 01:17:44.645507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5899,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=37000000,duration_sec=1274,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:17:44.646117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:17:44.646452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:627 - starting polling. Elapsed:0.004 Sep 04 01:17:44.648218 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:17:44.650586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:627 - port information retrieved. Elapsed:0.008 Sep 04 01:17:44.650922 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:627 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 04 01:17:45.247550 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c44e915c-22d4-47a1-b68f-039067803235 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Resource Port 5ee2ac7f-a0bd-48ec-87f1-756163b9c8c9 updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': '7d9ce754-4abe-4ff6-b267-baef93152378'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:17:45.248058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-c44e915c-22d4-47a1-b68f-039067803235 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (5ee2ac7f-a0bd-48ec-87f1-756163b9c8c9), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:17:46.643373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:628 started Sep 04 01:17:46.645852 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade589b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=37000000,duration_sec=1276,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:17:46.646433 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:17:46.646769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:628 - starting polling. Elapsed:0.004 Sep 04 01:17:46.648526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:17:46.650714 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:628 - port information retrieved. Elapsed:0.008 Sep 04 01:17:46.651079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:628 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 04 01:17:48.644712 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:629 started Sep 04 01:17:48.651313 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade589d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=39000000,duration_sec=1278,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:17:48.651900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:17:48.652244 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:629 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 04 01:17:50.646107 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:630 started Sep 04 01:17:50.648475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade589f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=40000000,duration_sec=1280,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:17:50.649030 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:17:50.649408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:630 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:17:52.646718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:631 started Sep 04 01:17:52.649252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade58a1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=41000000,duration_sec=1282,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:17:52.649825 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:17:52.650180 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:631 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:17:54.647342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:632 started Sep 04 01:17:54.649821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade58a3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=41000000,duration_sec=1284,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:17:54.650388 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:17:54.650790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:632 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:17:56.648611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:633 started Sep 04 01:17:56.651060 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade58a5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=43000000,duration_sec=1286,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:17:56.651619 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:17:56.651968 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:633 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:17:58.649709 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:634 started Sep 04 01:17:58.652154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade58a7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=44000000,duration_sec=1288,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:17:58.652719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:17:58.653067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:634 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:18:00.650482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:635 started Sep 04 01:18:00.652885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade58a9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=44000000,duration_sec=1290,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:18:00.653472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:18:00.653852 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:635 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:18:02.651144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:636 started Sep 04 01:18:02.653557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade58ab,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=45000000,duration_sec=1292,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:18:02.654214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:18:02.654560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:636 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:18:04.652332 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:637 started Sep 04 01:18:04.654722 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade58ad,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=46000000,duration_sec=1294,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:18:04.655310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:18:04.655658 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:637 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:18:06.653663 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:638 started Sep 04 01:18:06.656132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade58af,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=48000000,duration_sec=1296,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:18:06.657546 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:18:06.657902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:638 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:18:08.655011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:639 started Sep 04 01:18:08.658307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade58b1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=49000000,duration_sec=1298,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:18:08.658897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:18:08.659247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:639 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:18:10.655849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:640 started Sep 04 01:18:10.659192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade58b3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=50000000,duration_sec=1300,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:18:10.659798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:18:10.660182 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:640 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:18:12.657238 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:641 started Sep 04 01:18:12.659660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade58b5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=51000000,duration_sec=1302,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:18:12.660214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:18:12.660560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:641 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:18:14.658559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:642 started Sep 04 01:18:14.660966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade58b7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=53000000,duration_sec=1304,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:18:14.661552 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:18:14.661895 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:642 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:18:16.659225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:643 started Sep 04 01:18:16.661758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade58b9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=53000000,duration_sec=1306,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:18:16.662340 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:18:16.662688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:643 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:18:18.659952 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:644 started Sep 04 01:18:18.662411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade58bb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=54000000,duration_sec=1308,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:18:18.663000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:18:18.663348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:644 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:18:20.660780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:645 started Sep 04 01:18:20.663185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade58bd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=55000000,duration_sec=1310,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:18:20.663747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:18:20.664099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:645 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:18:22.661649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:646 started Sep 04 01:18:22.664067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade58bf,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=56000000,duration_sec=1312,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:18:22.664624 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:18:22.665002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:646 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:18:24.662528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:647 started Sep 04 01:18:24.665588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade58c1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=56000000,duration_sec=1314,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:18:24.666144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:18:24.666491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:647 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:18:26.663110 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:648 started Sep 04 01:18:26.665541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade58c3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=57000000,duration_sec=1316,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:18:26.666133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:18:26.666480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:648 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:18:28.664152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:649 started Sep 04 01:18:28.666543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade58c5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=58000000,duration_sec=1318,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:18:28.667126 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:18:28.667472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:649 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:18:30.665532 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:650 started Sep 04 01:18:30.672729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade58c7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=64000000,duration_sec=1320,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:18:30.673343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:18:30.673691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:650 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 04 01:18:32.666865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:651 started Sep 04 01:18:32.669310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade58c9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=61000000,duration_sec=1322,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:18:32.669874 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:18:32.670222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:651 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:18:34.667397 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:652 started Sep 04 01:18:34.670034 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade58cb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=61000000,duration_sec=1324,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:18:34.670603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:18:34.670954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:652 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:18:36.668351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:653 started Sep 04 01:18:36.670797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade58cd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=62000000,duration_sec=1326,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:18:36.671333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:18:36.671680 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:653 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:18:38.669009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:654 started Sep 04 01:18:38.671416 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade58cf,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=63000000,duration_sec=1328,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:18:38.671978 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:18:38.672326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:654 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:18:40.669691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:655 started Sep 04 01:18:40.672120 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade58d1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=64000000,duration_sec=1330,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:18:40.672687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:18:40.673033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:655 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:18:42.670911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:656 started Sep 04 01:18:42.673982 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade58d3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=65000000,duration_sec=1332,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:18:42.674559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:18:42.674912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:656 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:18:44.671469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:657 started Sep 04 01:18:44.674680 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade58d5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=65000000,duration_sec=1334,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:18:44.676666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:18:44.676666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:657 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:18:46.672982 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:658 started Sep 04 01:18:46.675942 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade58d7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=68000000,duration_sec=1336,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:18:46.676586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:18:46.676932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:658 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:18:48.674361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:659 started Sep 04 01:18:48.677280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade58d9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=68000000,duration_sec=1338,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:18:48.677844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:18:48.678194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:659 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:18:50.675621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:660 started Sep 04 01:18:50.678020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade58db,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=70000000,duration_sec=1340,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:18:50.678583 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:18:50.678925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:660 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:18:52.676325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:661 started Sep 04 01:18:52.678763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade58dd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=70000000,duration_sec=1342,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:18:52.679318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:18:52.679661 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:661 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:18:54.677815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:662 started Sep 04 01:18:54.680353 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade58df,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=72000000,duration_sec=1344,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:18:54.680910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:18:54.681284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:662 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:18:56.679135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:663 started Sep 04 01:18:56.681578 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade58e1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=73000000,duration_sec=1346,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:18:56.682161 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:18:56.682535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:663 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:18:58.680571 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:664 started Sep 04 01:18:58.682978 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade58e3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=75000000,duration_sec=1348,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:18:58.683533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:18:58.683878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:664 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:19:00.681982 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:665 started Sep 04 01:19:00.690204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade58e5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=76000000,duration_sec=1350,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:19:00.690204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:19:00.690204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:665 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:19:02.682775 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:666 started Sep 04 01:19:02.685272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade58e7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=77000000,duration_sec=1352,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:19:02.685843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:19:02.686194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:666 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:19:04.684031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:667 started Sep 04 01:19:04.686565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade58e9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=78000000,duration_sec=1354,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:19:04.692903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:19:04.692903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:667 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:19:06.685396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:668 started Sep 04 01:19:06.687864 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade58eb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=79000000,duration_sec=1356,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:19:06.688425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:19:06.688779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:668 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:19:08.686503 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:669 started Sep 04 01:19:08.689388 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade58ed,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=80000000,duration_sec=1358,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:19:08.690037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:19:08.690385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:669 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:19:10.687185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:670 started Sep 04 01:19:10.689670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade58ef,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=81000000,duration_sec=1360,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:19:10.690231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:19:10.691295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:670 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:19:12.688831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:671 started Sep 04 01:19:12.691926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade58f1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=83000000,duration_sec=1362,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:19:12.692509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:19:12.692854 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:671 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:19:14.689594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:672 started Sep 04 01:19:14.692206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade58f3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=84000000,duration_sec=1364,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:19:14.692761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:19:14.693128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:672 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:19:16.690723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:673 started Sep 04 01:19:16.694099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade58f5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=86000000,duration_sec=1366,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:19:16.694736 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:19:16.695100 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:673 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 04 01:19:18.692243 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:674 started Sep 04 01:19:18.694719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade58f7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=86000000,duration_sec=1368,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:19:18.695332 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:19:18.695699 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:674 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:19:20.693465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:675 started Sep 04 01:19:20.696304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade58f9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=88000000,duration_sec=1370,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:19:20.696872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:19:20.697259 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:675 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:19:22.694654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:676 started Sep 04 01:19:22.697005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade58fb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=89000000,duration_sec=1372,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:19:22.697590 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:19:22.697929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:676 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:19:24.695437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:677 started Sep 04 01:19:24.697919 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade58fd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=89000000,duration_sec=1374,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:19:24.698519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:19:24.698871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:677 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:19:26.696025 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:678 started Sep 04 01:19:26.698524 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade58ff,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=90000000,duration_sec=1376,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:19:26.699083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:19:26.699425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:678 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:19:28.696867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:679 started Sep 04 01:19:28.699315 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5901,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=91000000,duration_sec=1378,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:19:28.699882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:19:28.700262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:679 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:19:29.891771 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-9218f4e7-dc78-43a5-9ff4-5e4cfe024eb5 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:19:29Z,data_plane_status=None,description='',device_id='1af95d46-3118-449e-9a37-63298088e3ea',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=7013b090-a02a-4f55-8e96-e743cde4d73a,mac_address=fa:16:3e:26:52:e1,name='',network_id=ca88993b-9210-4173-b062-c40cdf9e1da6,numa_affinity_policy=,project_id='2506b96ac13541e6a7a47c5aedca67e5',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(7013b090-a02a-4f55-8e96-e743cde4d73a),security_group_ids=set([46402ba3-28d6-4a31-82e5-99b05a90c3c7]),status='DOWN',updated_at=2022-09-04T01:19:29Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:19:29.892441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-9218f4e7-dc78-43a5-9ff4-5e4cfe024eb5 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (7013b090-a02a-4f55-8e96-e743cde4d73a), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:19:29.892576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-9218f4e7-dc78-43a5-9ff4-5e4cfe024eb5 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Security group member updated {'46402ba3-28d6-4a31-82e5-99b05a90c3c7'} Sep 04 01:19:30.533255 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-5889ecc3-4a82-4d21-9a6e-6eb80e4787cc service neutron] Resource Port 7013b090-a02a-4f55-8e96-e743cde4d73a updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=7013b090-a02a-4f55-8e96-e743cde4d73a,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=7013b090-a02a-4f55-8e96-e743cde4d73a,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:19:30.533644 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-5889ecc3-4a82-4d21-9a6e-6eb80e4787cc service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (7013b090-a02a-4f55-8e96-e743cde4d73a), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:19:30.697423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:680 started Sep 04 01:19:30.700044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5903,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=92000000,duration_sec=1380,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:19:30.700679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:19:30.701018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:680 - starting polling. Elapsed:0.004 Sep 04 01:19:30.707193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:19:30.707193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:680 - port information retrieved. Elapsed:0.008 Sep 04 01:19:30.707193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:680 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 04 01:19:30.841159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-5889ecc3-4a82-4d21-9a6e-6eb80e4787cc service neutron] Resource Port 7013b090-a02a-4f55-8e96-e743cde4d73a updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=7013b090-a02a-4f55-8e96-e743cde4d73a,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=7013b090-a02a-4f55-8e96-e743cde4d73a,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=7013b090-a02a-4f55-8e96-e743cde4d73a,segment=NetworkSegment(ec3b99f9-cd00-455f-aba9-a56f7e7f2980),segment_id=ec3b99f9-cd00-455f-aba9-a56f7e7f2980)]} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:19:30.841548 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-5889ecc3-4a82-4d21-9a6e-6eb80e4787cc service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (7013b090-a02a-4f55-8e96-e743cde4d73a), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:19:32.698924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:681 started Sep 04 01:19:32.701426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5905,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=93000000,duration_sec=1382,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:19:32.702007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:19:32.702346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:681 - starting polling. Elapsed:0.004 Sep 04 01:19:32.704094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:19:32.706274 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:681 - port information retrieved. Elapsed:0.008 Sep 04 01:19:32.706628 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:681 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 04 01:19:34.700027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:682 started Sep 04 01:19:34.702556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5907,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=94000000,duration_sec=1384,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:19:34.703139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:19:34.703488 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:682 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:19:36.701414 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:683 started Sep 04 01:19:36.703846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5909,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=95000000,duration_sec=1386,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:19:36.705025 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:19:36.705425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:683 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:19:38.701913 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:684 started Sep 04 01:19:38.704295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade590b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=96000000,duration_sec=1388,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:19:38.704852 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:19:38.705231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:684 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:19:39.832865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Resource Port 7013b090-a02a-4f55-8e96-e743cde4d73a updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:19:39.833618 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (7013b090-a02a-4f55-8e96-e743cde4d73a), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:19:40.702848 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:685 started Sep 04 01:19:40.705387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade590d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=97000000,duration_sec=1390,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:19:40.705972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:19:40.706310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:685 - starting polling. Elapsed:0.004 Sep 04 01:19:40.709192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:19:40.711402 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:685 - port information retrieved. Elapsed:0.009 Sep 04 01:19:40.711740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:685 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 04 01:19:41.875330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Resource Port 7013b090-a02a-4f55-8e96-e743cde4d73a updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:19:41.875958 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-70ae8568-2b8d-4dc8-bee2-f60c48361960 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (7013b090-a02a-4f55-8e96-e743cde4d73a), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:19:42.703748 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:686 started Sep 04 01:19:42.706115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade590f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=98000000,duration_sec=1392,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:19:42.706715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:19:42.707043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:686 - starting polling. Elapsed:0.004 Sep 04 01:19:42.709856 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:19:42.712015 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:686 - port information retrieved. Elapsed:0.009 Sep 04 01:19:42.712341 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:686 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 04 01:19:44.704807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:687 started Sep 04 01:19:44.707248 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5911,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=99000000,duration_sec=1394,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:19:44.707853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:19:44.708191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:687 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:19:44.800997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-d379aab5-1eab-4b98-8f96-a206c3ec807e tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-04T01:19:44Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=2cb92656-0703-4e63-aea6-6a33af32438b,mac_address=fa:16:3e:c9:85:3a,name='',network_id=e8e0564a-d5c9-4fe0-b2d4-538f45096708,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(2cb92656-0703-4e63-aea6-6a33af32438b),security_group_ids=set([]),status='N/A',updated_at=2022-09-04T01:19:44Z) {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:192}} Sep 04 01:19:44.802085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-d379aab5-1eab-4b98-8f96-a206c3ec807e tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (2cb92656-0703-4e63-aea6-6a33af32438b), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:19:45.547339 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-d379aab5-1eab-4b98-8f96-a206c3ec807e tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Resource Port 2cb92656-0703-4e63-aea6-6a33af32438b updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': '81f900c1-3ec9-4084-8a6c-417d2bf9b327'} {{(pid=107812) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:185}} Sep 04 01:19:45.547716 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-d379aab5-1eab-4b98-8f96-a206c3ec807e tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-67611'] for Port (2cb92656-0703-4e63-aea6-6a33af32438b), after_update {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:19:46.705443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:688 started Sep 04 01:19:46.707884 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5913,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=99000000,duration_sec=1396,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:19:46.708453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:19:46.708779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:688 - starting polling. Elapsed:0.004 Sep 04 01:19:46.710578 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:19:46.712853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:688 - port information retrieved. Elapsed:0.008 Sep 04 01:19:46.713204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:688 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 04 01:19:48.705957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:689 started Sep 04 01:19:48.709112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5915,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=100000000,duration_sec=1398,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:19:48.709664 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:19:48.710011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:689 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:19:50.706966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:690 started Sep 04 01:19:50.709352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5917,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=101000000,duration_sec=1400,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:19:50.709911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:19:50.710255 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:690 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:19:52.707740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:691 started Sep 04 01:19:52.710100 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5919,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=102000000,duration_sec=1402,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:19:52.710658 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:19:52.711003 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:691 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:19:54.708141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:692 started Sep 04 01:19:54.710507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade591b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=102000000,duration_sec=1404,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:19:54.711070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:19:54.711413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:692 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:19:56.709401 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:693 started Sep 04 01:19:56.711766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade591d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=103000000,duration_sec=1406,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:19:56.712322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:19:56.712670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:693 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:19:58.710497 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:694 started Sep 04 01:19:58.712906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade591f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=104000000,duration_sec=1408,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:19:58.713570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:19:58.713865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:694 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:20:00.711449 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:695 started Sep 04 01:20:00.714204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5921,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=105000000,duration_sec=1410,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:20:00.714824 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:20:00.715191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:695 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:20:02.712173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:696 started Sep 04 01:20:02.714646 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5923,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=106000000,duration_sec=1412,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:20:02.715149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:20:02.715498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:696 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:20:04.712987 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:697 started Sep 04 01:20:04.715337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5925,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=107000000,duration_sec=1414,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:20:04.715916 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:20:04.716259 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:697 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:20:06.713625 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:698 started Sep 04 01:20:06.716139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5927,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=108000000,duration_sec=1416,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:20:06.716629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:20:06.717004 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:698 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:20:08.715112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:699 started Sep 04 01:20:08.717499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5929,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=109000000,duration_sec=1418,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:20:08.718064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:20:08.718414 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:699 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:20:10.715694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:700 started Sep 04 01:20:10.718144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade592b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=110000000,duration_sec=1420,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:20:10.718700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:20:10.719073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:700 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:20:12.716717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:701 started Sep 04 01:20:12.719402 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade592d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=111000000,duration_sec=1422,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:20:12.719996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:20:12.720345 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:701 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:20:14.717489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:702 started Sep 04 01:20:14.719976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade592f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=111000000,duration_sec=1424,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:20:14.720554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:20:14.720899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:702 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:20:16.718650 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:703 started Sep 04 01:20:16.721015 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5931,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=113000000,duration_sec=1426,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:20:16.721602 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:20:16.721944 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:703 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:20:18.719352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:704 started Sep 04 01:20:18.721739 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5933,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=113000000,duration_sec=1428,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:20:18.722305 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:20:18.722650 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:704 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:20:20.719938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:705 started Sep 04 01:20:20.722266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5935,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=114000000,duration_sec=1430,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:20:20.722828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:20:20.723786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:705 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:20:22.721607 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:706 started Sep 04 01:20:22.724889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5937,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=116000000,duration_sec=1432,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:20:22.725477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:20:22.725830 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:706 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:20:24.722254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:707 started Sep 04 01:20:24.725566 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5939,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=117000000,duration_sec=1434,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:20:24.726121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:20:24.726491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:707 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:20:26.722979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:708 started Sep 04 01:20:26.725552 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade593b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=117000000,duration_sec=1436,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:20:26.729371 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:20:26.729371 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:708 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:20:28.723428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:709 started Sep 04 01:20:28.726703 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade593d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=118000000,duration_sec=1438,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:20:28.727286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:20:28.727626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:709 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:20:30.725257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:710 started Sep 04 01:20:30.727580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade593f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=119000000,duration_sec=1440,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:20:30.728211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:20:30.728562 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:710 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:20:32.726155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:711 started Sep 04 01:20:32.728557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5941,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=120000000,duration_sec=1442,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:20:32.729149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:20:32.729502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:711 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:20:34.727651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:712 started Sep 04 01:20:34.729969 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5943,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=122000000,duration_sec=1444,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:20:34.730521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:20:34.730891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:712 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:20:36.729227 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:713 started Sep 04 01:20:36.731689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5945,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=123000000,duration_sec=1446,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:20:36.732261 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:20:36.732614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:713 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:20:38.730661 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:714 started Sep 04 01:20:38.733340 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5947,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=125000000,duration_sec=1448,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:20:38.733972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:20:38.734323 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:714 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:20:40.731246 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:715 started Sep 04 01:20:40.734129 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5949,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=125000000,duration_sec=1450,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:20:40.734718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:20:40.735066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:715 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:20:42.732039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:716 started Sep 04 01:20:42.734385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade594b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=126000000,duration_sec=1452,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:20:42.734945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:20:42.735288 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:716 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:20:44.733022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:717 started Sep 04 01:20:44.736863 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade594d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=128000000,duration_sec=1454,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:20:44.737477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:20:44.737850 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:717 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 04 01:20:46.734534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:718 started Sep 04 01:20:46.736849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade594f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=128000000,duration_sec=1456,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:20:46.737441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:20:46.737794 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:718 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:20:48.735129 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:719 started Sep 04 01:20:48.737499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5951,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=129000000,duration_sec=1458,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:20:48.738055 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:20:48.738399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:719 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:20:50.735991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:720 started Sep 04 01:20:50.738486 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5953,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=130000000,duration_sec=1460,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:20:50.739046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:20:50.740139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:720 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:20:52.736959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:721 started Sep 04 01:20:52.740039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5955,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=131000000,duration_sec=1462,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:20:52.740600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:20:52.740947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:721 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:20:54.737605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:722 started Sep 04 01:20:54.740041 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5957,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=132000000,duration_sec=1464,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:20:54.740603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:20:54.740951 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:722 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:20:56.738131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:723 started Sep 04 01:20:56.741003 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5959,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=133000000,duration_sec=1466,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:20:56.741604 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:20:56.741950 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:723 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:20:58.738697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:724 started Sep 04 01:20:58.741293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade595b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=133000000,duration_sec=1468,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:20:58.741854 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:20:58.742207 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:724 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:21:00.739635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:725 started Sep 04 01:21:00.742058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade595d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=134000000,duration_sec=1470,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:21:00.742609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:21:00.742954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:725 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:21:02.740810 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:726 started Sep 04 01:21:02.743491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade595f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=135000000,duration_sec=1472,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:21:02.744078 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:21:02.744457 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:726 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:21:04.741535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:727 started Sep 04 01:21:04.744034 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5961,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=136000000,duration_sec=1474,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:21:04.744603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:21:04.744954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:727 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:21:06.742143 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:728 started Sep 04 01:21:06.748974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5963,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=136000000,duration_sec=1476,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:21:06.749601 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:21:06.749980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:728 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 04 01:21:08.743001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:729 started Sep 04 01:21:08.745323 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5965,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=137000000,duration_sec=1478,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:21:08.745880 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:21:08.746225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:729 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:21:10.744050 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:730 started Sep 04 01:21:10.746515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5967,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=138000000,duration_sec=1480,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:21:10.747072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:21:10.747414 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:730 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:21:12.744580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:731 started Sep 04 01:21:12.746935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5969,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=139000000,duration_sec=1482,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:21:12.747493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:21:12.748082 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:731 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:21:13.893775 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-b4101d1c-0c07-4979-adc7-b8fb2da3f6a0 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Resource Port deleted: 2cb92656-0703-4e63-aea6-6a33af32438b {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:21:13.894457 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-b4101d1c-0c07-4979-adc7-b8fb2da3f6a0 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (2cb92656-0703-4e63-aea6-6a33af32438b), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:21:14.746045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:732 started Sep 04 01:21:14.749146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade596b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=140000000,duration_sec=1484,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:21:14.757359 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:21:14.757972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:732 - starting polling. Elapsed:0.012 Sep 04 01:21:14.759824 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:21:14.760994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 2cb92656-0703-4e63-aea6-6a33af32438b not present in bridge br-int Sep 04 01:21:14.761350 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] net_uuid None not managed by VLAN manager Sep 04 01:21:14.765115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for ['2cb92656-0703-4e63-aea6-6a33af32438b'] Sep 04 01:21:14.765463 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 2cb92656-0703-4e63-aea6-6a33af32438b is not handled by the firewall. {{(pid=107812) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 04 01:21:14.773327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:732 - port information retrieved. Elapsed:0.027 Sep 04 01:21:14.773663 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:732 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.028 Sep 04 01:21:16.747735 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:733 started Sep 04 01:21:16.750424 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade596d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=142000000,duration_sec=1486,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:21:16.750978 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:21:16.751321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:733 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:21:16.811377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-d71170e6-d928-476e-b980-87e3924a4ffb tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Resource Port deleted: 7013b090-a02a-4f55-8e96-e743cde4d73a {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:21:16.811769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-d71170e6-d928-476e-b980-87e3924a4ffb tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (7013b090-a02a-4f55-8e96-e743cde4d73a), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:21:16.812183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-d71170e6-d928-476e-b980-87e3924a4ffb tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Security group member updated {'46402ba3-28d6-4a31-82e5-99b05a90c3c7'} Sep 04 01:21:18.748799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:734 started Sep 04 01:21:18.751494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade596f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=143000000,duration_sec=1488,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:21:18.752171 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:21:18.752502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:734 - starting polling. Elapsed:0.004 Sep 04 01:21:18.754292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:21:18.756074 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 7013b090-a02a-4f55-8e96-e743cde4d73a not present in bridge br-int Sep 04 01:21:18.756444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] net_uuid None not managed by VLAN manager Sep 04 01:21:18.756731 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for ['7013b090-a02a-4f55-8e96-e743cde4d73a'] Sep 04 01:21:18.757051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 7013b090-a02a-4f55-8e96-e743cde4d73a is not handled by the firewall. {{(pid=107812) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 04 01:21:18.759145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:734 - port information retrieved. Elapsed:0.011 Sep 04 01:21:18.759473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:734 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 04 01:21:20.749915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:735 started Sep 04 01:21:20.752263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5971,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=144000000,duration_sec=1490,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:21:20.752839 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:21:20.753222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:735 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:21:22.343895 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-f9b7fb8a-c846-4877-a537-45fde9b581a8 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Resource Port deleted: 5ee2ac7f-a0bd-48ec-87f1-756163b9c8c9 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:21:22.344440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-f9b7fb8a-c846-4877-a537-45fde9b581a8 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (5ee2ac7f-a0bd-48ec-87f1-756163b9c8c9), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:21:22.750779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:736 started Sep 04 01:21:22.753911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5973,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=145000000,duration_sec=1492,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:21:22.755402 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:21:22.756021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:736 - starting polling. Elapsed:0.005 Sep 04 01:21:22.758924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:21:22.762331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 5ee2ac7f-a0bd-48ec-87f1-756163b9c8c9 not present in bridge br-int Sep 04 01:21:22.762877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] net_uuid None not managed by VLAN manager Sep 04 01:21:22.763356 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for ['5ee2ac7f-a0bd-48ec-87f1-756163b9c8c9'] Sep 04 01:21:22.763894 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 5ee2ac7f-a0bd-48ec-87f1-756163b9c8c9 is not handled by the firewall. {{(pid=107812) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 04 01:21:22.768032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:736 - port information retrieved. Elapsed:0.017 Sep 04 01:21:22.768589 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:736 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.018 Sep 04 01:21:24.762313 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:737 started Sep 04 01:21:24.762313 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5975,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=147000000,duration_sec=1494,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:21:24.762313 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:21:24.762313 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:737 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:21:25.280310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4e5d90cf-b6de-42b6-b6a3-e0dc49746b7f tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Resource Port deleted: da467063-2304-41a7-80d8-d19cc5f69f7a {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:21:25.280310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4e5d90cf-b6de-42b6-b6a3-e0dc49746b7f tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (da467063-2304-41a7-80d8-d19cc5f69f7a), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:21:25.280310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-4e5d90cf-b6de-42b6-b6a3-e0dc49746b7f tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Security group member updated {'46402ba3-28d6-4a31-82e5-99b05a90c3c7'} Sep 04 01:21:26.753614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:738 started Sep 04 01:21:26.756778 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5977,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=148000000,duration_sec=1496,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:21:26.757364 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:21:26.757762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:738 - starting polling. Elapsed:0.004 Sep 04 01:21:26.759488 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:21:26.760685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port da467063-2304-41a7-80d8-d19cc5f69f7a not present in bridge br-int Sep 04 01:21:26.761016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] net_uuid None not managed by VLAN manager Sep 04 01:21:26.761323 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for ['da467063-2304-41a7-80d8-d19cc5f69f7a'] Sep 04 01:21:26.761637 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port da467063-2304-41a7-80d8-d19cc5f69f7a is not handled by the firewall. {{(pid=107812) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 04 01:21:26.763717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:738 - port information retrieved. Elapsed:0.010 Sep 04 01:21:26.764046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:738 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 04 01:21:28.234078 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-8babb4ea-4d0a-49e0-885c-9524e529af10 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Resource Port deleted: 94af0c51-d74e-4c78-9466-ecd1c16abdc2 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:21:28.234678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-8babb4ea-4d0a-49e0-885c-9524e529af10 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (94af0c51-d74e-4c78-9466-ecd1c16abdc2), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:21:28.754227 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:739 started Sep 04 01:21:28.756428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5979,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=148000000,duration_sec=1498,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:21:28.756988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:21:28.758068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:739 - starting polling. Elapsed:0.003 Sep 04 01:21:28.759938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:21:28.761160 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 94af0c51-d74e-4c78-9466-ecd1c16abdc2 not present in bridge br-int Sep 04 01:21:28.761493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] net_uuid None not managed by VLAN manager Sep 04 01:21:28.761773 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for ['94af0c51-d74e-4c78-9466-ecd1c16abdc2'] Sep 04 01:21:28.762086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 94af0c51-d74e-4c78-9466-ecd1c16abdc2 is not handled by the firewall. {{(pid=107812) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 04 01:21:28.764168 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:739 - port information retrieved. Elapsed:0.010 Sep 04 01:21:28.764492 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:739 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Sep 04 01:21:29.879360 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-efa869f0-7ad5-440a-ae93-2dd8d8a42ea7 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Resource SecurityGroup deleted: 46402ba3-28d6-4a31-82e5-99b05a90c3c7 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:21:29.879946 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-efa869f0-7ad5-440a-ae93-2dd8d8a42ea7 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (46402ba3-28d6-4a31-82e5-99b05a90c3c7), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:21:29.880268 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-efa869f0-7ad5-440a-ae93-2dd8d8a42ea7 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('46402ba3-28d6-4a31-82e5-99b05a90c3c7',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:21:29.894980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-efa869f0-7ad5-440a-ae93-2dd8d8a42ea7 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('46402ba3-28d6-4a31-82e5-99b05a90c3c7',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:21:29.897529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-efa869f0-7ad5-440a-ae93-2dd8d8a42ea7 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Resource SecurityGroupRule deleted: 23f0bcd4-419e-4743-b9ee-1bc0da573239 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:21:29.897529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-efa869f0-7ad5-440a-ae93-2dd8d8a42ea7 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (23f0bcd4-419e-4743-b9ee-1bc0da573239), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:21:29.897529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-efa869f0-7ad5-440a-ae93-2dd8d8a42ea7 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Security group rule updated ['46402ba3-28d6-4a31-82e5-99b05a90c3c7'] Sep 04 01:21:29.897529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-efa869f0-7ad5-440a-ae93-2dd8d8a42ea7 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Resource SecurityGroupRule deleted: 259933b8-ef63-4353-841f-aa432e147c11 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:21:29.897944 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-efa869f0-7ad5-440a-ae93-2dd8d8a42ea7 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (259933b8-ef63-4353-841f-aa432e147c11), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:21:29.897944 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-efa869f0-7ad5-440a-ae93-2dd8d8a42ea7 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Security group rule updated ['46402ba3-28d6-4a31-82e5-99b05a90c3c7'] Sep 04 01:21:29.897944 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-efa869f0-7ad5-440a-ae93-2dd8d8a42ea7 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Resource SecurityGroupRule deleted: 542c8814-2b98-41e9-a6d7-da8a5ede20fd {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:21:29.898220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-efa869f0-7ad5-440a-ae93-2dd8d8a42ea7 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (542c8814-2b98-41e9-a6d7-da8a5ede20fd), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:21:29.898515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-efa869f0-7ad5-440a-ae93-2dd8d8a42ea7 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Security group rule updated ['46402ba3-28d6-4a31-82e5-99b05a90c3c7'] Sep 04 01:21:29.898934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-efa869f0-7ad5-440a-ae93-2dd8d8a42ea7 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Resource SecurityGroupRule deleted: 8425d71a-4431-47a2-9473-e64c71a2f5ae {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:21:29.899276 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-efa869f0-7ad5-440a-ae93-2dd8d8a42ea7 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (8425d71a-4431-47a2-9473-e64c71a2f5ae), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:21:29.899594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-efa869f0-7ad5-440a-ae93-2dd8d8a42ea7 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Security group rule updated ['46402ba3-28d6-4a31-82e5-99b05a90c3c7'] Sep 04 01:21:29.900010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-efa869f0-7ad5-440a-ae93-2dd8d8a42ea7 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Resource SecurityGroupRule deleted: f1621524-468e-4b23-8c14-f21f6c992d64 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:21:29.900372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-efa869f0-7ad5-440a-ae93-2dd8d8a42ea7 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (f1621524-468e-4b23-8c14-f21f6c992d64), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:21:29.900688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-efa869f0-7ad5-440a-ae93-2dd8d8a42ea7 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Security group rule updated ['46402ba3-28d6-4a31-82e5-99b05a90c3c7'] Sep 04 01:21:29.901128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-efa869f0-7ad5-440a-ae93-2dd8d8a42ea7 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Resource SecurityGroupRule deleted: 5e5bc260-d0c2-44f9-b0b2-dd1781b7c1d2 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:21:29.901467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-efa869f0-7ad5-440a-ae93-2dd8d8a42ea7 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (5e5bc260-d0c2-44f9-b0b2-dd1781b7c1d2), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:21:29.901781 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-efa869f0-7ad5-440a-ae93-2dd8d8a42ea7 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Security group rule updated ['46402ba3-28d6-4a31-82e5-99b05a90c3c7'] Sep 04 01:21:29.902220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-efa869f0-7ad5-440a-ae93-2dd8d8a42ea7 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Resource SecurityGroupRule deleted: 7edf25a1-5342-4be5-acb2-99b0e8677c56 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:21:29.902581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-efa869f0-7ad5-440a-ae93-2dd8d8a42ea7 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (7edf25a1-5342-4be5-acb2-99b0e8677c56), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:21:29.902896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-efa869f0-7ad5-440a-ae93-2dd8d8a42ea7 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Security group rule updated ['46402ba3-28d6-4a31-82e5-99b05a90c3c7'] Sep 04 01:21:29.903305 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-efa869f0-7ad5-440a-ae93-2dd8d8a42ea7 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Resource SecurityGroupRule deleted: 044523d6-5970-4588-a93c-1d70f0b40cc0 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:21:29.903640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-efa869f0-7ad5-440a-ae93-2dd8d8a42ea7 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (044523d6-5970-4588-a93c-1d70f0b40cc0), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:21:29.903954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-efa869f0-7ad5-440a-ae93-2dd8d8a42ea7 tempest-TestVolumeBootPattern-1801805144 tempest-TestVolumeBootPattern-1801805144-project] Security group rule updated ['46402ba3-28d6-4a31-82e5-99b05a90c3c7'] Sep 04 01:21:30.755351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:740 started Sep 04 01:21:30.758660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade597b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=149000000,duration_sec=1500,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:21:30.759239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:21:30.759594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:740 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 04 01:21:31.255951 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-9c4b1798-bb20-4086-8f43-aa7a243d2033 admin admin] Resource Port deleted: c73d8972-0881-4e30-8303-b09f2c82f2f0 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:21:31.256604 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-9c4b1798-bb20-4086-8f43-aa7a243d2033 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (c73d8972-0881-4e30-8303-b09f2c82f2f0), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:21:32.271660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["fdd9c160-e5e1-443f-997a-3c8dd4ae619f","delete","qr-c73d8972-08",35,["map",[["attached-mac","fa:16:3e:b7:43:f1"],["iface-id","c73d8972-0881-4e30-8303-b09f2c82f2f0"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:21:32.426280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-6025e5bd-be84-4369-b19c-560474fa5792 admin admin] Resource Port deleted: 491c36f8-0074-4f7c-870c-6d117c1f71b6 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:21:32.430678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-6025e5bd-be84-4369-b19c-560474fa5792 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (491c36f8-0074-4f7c-870c-6d117c1f71b6), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:21:32.668878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["18b26b27-6de0-43ac-a74e-a5200267d668","delete","qg-491c36f8-00",34,["map",[["attached-mac","fa:16:3e:6d:92:3b"],["iface-id","491c36f8-0074-4f7c-870c-6d117c1f71b6"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:21:32.756140 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:741 started Sep 04 01:21:32.961775 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade597d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=351000000,duration_sec=1502,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:21:32.962953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:21:32.962953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:741 - starting polling. Elapsed:0.207 Sep 04 01:21:32.965025 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:21:32.968602 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade597f,OFPFlowMod(buffer_id=4294967295,command=3,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 34}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:21:32.970278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade5981,OFPFlowMod(buffer_id=4294967295,command=3,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 35}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:21:32.970584 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:741 - port information retrieved. Elapsed:0.215 Sep 04 01:21:32.970932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Starting to process devices in:{'current': {'20940f6e-c5ec-497b-b144-a180350e4857', '3fa24970-97a7-4f46-ac55-0b24323fa402', '2c3ac556-7316-478e-a2cf-0863e3b01f18', '89aa06b4-bbf1-40c2-bb48-500c3aecdf48', '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', '996205b2-4ccc-4913-8458-2e4f1e0e6687', '4e686822-d1bf-4795-baed-c36577dc9ff3', 'ca102ce7-433c-4029-aabf-33d944165ff1'}, 'added': set(), 'removed': {'c73d8972-0881-4e30-8303-b09f2c82f2f0', '491c36f8-0074-4f7c-870c-6d117c1f71b6'}, 'updated': set(), 're_added': set()} {{(pid=107812) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 04 01:21:32.971258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:741 - agent port security group processed in 0.000 Sep 04 01:21:32.972586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Configuration for devices up [] and devices down [] completed. Sep 04 01:21:32.972878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for {'c73d8972-0881-4e30-8303-b09f2c82f2f0', '491c36f8-0074-4f7c-870c-6d117c1f71b6'} Sep 04 01:21:32.973458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 8 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:21:33.011837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed5593d-be80-49d3-9829-87da0bd5b291]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:21:33.012471 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Ports {'c73d8972-0881-4e30-8303-b09f2c82f2f0', '491c36f8-0074-4f7c-870c-6d117c1f71b6'} removed Sep 04 01:21:33.064847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port removal failed for set() {{(pid=107812) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 04 01:21:33.065440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:741 - treat_devices_removed completed in 0.093 Sep 04 01:21:33.065799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:741 - ports processed. Elapsed:0.310 Sep 04 01:21:33.066242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:741 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 2}}. Elapsed:0.310 Sep 04 01:21:33.083652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-c4059b08-bbd8-4bf4-bcc7-215685ef0f6b admin admin] Resource Subnet deleted: 53b46299-8023-4a0f-bdf3-86b9a7286814 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:21:33.083652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-c4059b08-bbd8-4bf4-bcc7-215685ef0f6b admin admin] Publish callbacks [] for Subnet (53b46299-8023-4a0f-bdf3-86b9a7286814), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:21:33.221990 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["08f4d551-8d43-435c-832a-dee184c841f7","delete","tap996205b2-4c",33,["map",[["attached-mac","fa:16:3e:3c:e3:90"],["iface-id","996205b2-4ccc-4913-8458-2e4f1e0e6687"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:21:33.480346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4c289492-a13d-42ba-9768-5e1bda071a4f admin admin] Resource Port deleted: 996205b2-4ccc-4913-8458-2e4f1e0e6687 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:21:33.481054 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4c289492-a13d-42ba-9768-5e1bda071a4f admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (996205b2-4ccc-4913-8458-2e4f1e0e6687), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:21:33.647181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-02df44b2-e323-40f1-9706-e996767a039b None None] Resource Port deleted: 996205b2-4ccc-4913-8458-2e4f1e0e6687 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:21:33.647181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-02df44b2-e323-40f1-9706-e996767a039b None None] Skipped duplicate delete event for 996205b2-4ccc-4913-8458-2e4f1e0e6687 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:209}} Sep 04 01:21:33.787554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-4c289492-a13d-42ba-9768-5e1bda071a4f admin admin] Resource Network deleted: ca88993b-9210-4173-b062-c40cdf9e1da6 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:21:33.787990 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-4c289492-a13d-42ba-9768-5e1bda071a4f admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533'] for Network (ca88993b-9210-4173-b062-c40cdf9e1da6), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:21:34.703668 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-8bcdc87e-9970-4a5e-ad60-740c35032b2c admin admin] Resource Port deleted: 4e686822-d1bf-4795-baed-c36577dc9ff3 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:21:34.704734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-8bcdc87e-9970-4a5e-ad60-740c35032b2c admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (4e686822-d1bf-4795-baed-c36577dc9ff3), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:21:34.757687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:742 started Sep 04 01:21:34.760249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5983,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=152000000,duration_sec=1504,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:21:34.761409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:21:34.762165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:742 - starting polling. Elapsed:0.005 Sep 04 01:21:34.764053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:21:34.770333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-4e686822-d1, col_values=(('tag', 4095),)) {{(pid=107812) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 04 01:21:34.781467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade5985,OFPFlowMod(buffer_id=4294967295,command=0,cookie=6887031442322345889,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 38}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:21:34.781954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for ['4e686822-d1bf-4795-baed-c36577dc9ff3'] Sep 04 01:21:34.782493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 4 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:21:34.821549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdaa4695-1f9c-412e-a9b5-dc32f174abf9]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:21:34.826618 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade5987,OFPFlowMod(buffer_id=4294967295,command=3,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 33}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:21:34.826995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:742 - port information retrieved. Elapsed:0.070 Sep 04 01:21:34.827327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Starting to process devices in:{'current': {'20940f6e-c5ec-497b-b144-a180350e4857', '3fa24970-97a7-4f46-ac55-0b24323fa402', '2c3ac556-7316-478e-a2cf-0863e3b01f18', '89aa06b4-bbf1-40c2-bb48-500c3aecdf48', '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', '4e686822-d1bf-4795-baed-c36577dc9ff3', 'ca102ce7-433c-4029-aabf-33d944165ff1'}, 'added': set(), 'removed': {'996205b2-4ccc-4913-8458-2e4f1e0e6687'}, 'updated': set(), 're_added': set()} {{(pid=107812) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 04 01:21:34.828083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:742 - agent port security group processed in 0.000 Sep 04 01:21:34.829491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Configuration for devices up [] and devices down [] completed. Sep 04 01:21:34.829866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for {'996205b2-4ccc-4913-8458-2e4f1e0e6687'} Sep 04 01:21:34.830367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 4 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:21:34.872020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[423cf794-f2ef-449d-b990-6d96c52c12df]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:21:34.872681 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Ports {'996205b2-4ccc-4913-8458-2e4f1e0e6687'} removed Sep 04 01:21:34.902834 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port removal failed for set() {{(pid=107812) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 04 01:21:34.903339 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Reclaiming vlan = 13 from net-id = ca88993b-9210-4173-b062-c40cdf9e1da6, seg-id = 150 Sep 04 01:21:34.910288 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x1fd38c1b,OFPFlowMod(buffer_id=4294967295,command=3,cookie=6561907047025962751,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4109}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:21:34.910288 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xeade5989,OFPFlowMod(buffer_id=4294967295,command=3,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4246}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:21:34.910288 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:742 - treat_devices_removed completed in 0.079 Sep 04 01:21:34.910288 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:742 - ports processed. Elapsed:0.152 Sep 04 01:21:34.910700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:742 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 1}}. Elapsed:0.153 Sep 04 01:21:36.003566 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["e36caa31-e30e-496d-b42e-e1c12d36408f","delete","qr-4e686822-d1",38,["map",[["attached-mac","fa:16:3e:85:6a:3d"],["iface-id","4e686822-d1bf-4795-baed-c36577dc9ff3"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:21:36.115648 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-8246d049-4b90-4610-bc1d-b4e6acd982cc admin admin] Resource Port deleted: 2c3ac556-7316-478e-a2cf-0863e3b01f18 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:21:36.120290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-8246d049-4b90-4610-bc1d-b4e6acd982cc admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (2c3ac556-7316-478e-a2cf-0863e3b01f18), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:21:36.133190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["fbfd7991-8eba-4b0e-a721-4a22f5382690","delete","qg-2c3ac556-73",37,["map",[["attached-mac","fa:16:3e:5b:36:9e"],["iface-id","2c3ac556-7316-478e-a2cf-0863e3b01f18"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:21:36.715605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-54ca9928-2ec4-4b73-b7bd-7568b01b82d7 admin admin] Resource Subnet deleted: 223df0be-5574-4032-ab9c-4edcc292cdff {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:21:36.715977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-54ca9928-2ec4-4b73-b7bd-7568b01b82d7 admin admin] Publish callbacks [] for Subnet (223df0be-5574-4032-ab9c-4edcc292cdff), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:21:36.758126 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:743 started Sep 04 01:21:36.760825 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade598b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=152000000,duration_sec=1506,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:21:36.761751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:21:36.762271 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:743 - starting polling. Elapsed:0.004 Sep 04 01:21:36.763827 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:21:36.768783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade598d,OFPFlowMod(buffer_id=4294967295,command=3,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 37}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:21:36.770615 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade598f,OFPFlowMod(buffer_id=4294967295,command=3,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 38}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:21:36.771319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:743 - port information retrieved. Elapsed:0.013 Sep 04 01:21:36.771838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Starting to process devices in:{'current': {'20940f6e-c5ec-497b-b144-a180350e4857', '3fa24970-97a7-4f46-ac55-0b24323fa402', '89aa06b4-bbf1-40c2-bb48-500c3aecdf48', '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', 'ca102ce7-433c-4029-aabf-33d944165ff1'}, 'added': set(), 'removed': {'4e686822-d1bf-4795-baed-c36577dc9ff3', '2c3ac556-7316-478e-a2cf-0863e3b01f18'}, 'updated': set(), 're_added': set()} {{(pid=107812) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 04 01:21:36.772163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:743 - agent port security group processed in 0.000 Sep 04 01:21:36.773529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Configuration for devices up [] and devices down [] completed. Sep 04 01:21:36.774004 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for {'4e686822-d1bf-4795-baed-c36577dc9ff3', '2c3ac556-7316-478e-a2cf-0863e3b01f18'} Sep 04 01:21:36.774337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port 4e686822-d1bf-4795-baed-c36577dc9ff3 is not handled by the firewall. {{(pid=107812) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 04 01:21:36.774757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 4 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:21:36.816077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd5b263c-8768-410f-abf8-a050ddf1dc7e]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:21:36.817216 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Ports {'4e686822-d1bf-4795-baed-c36577dc9ff3', '2c3ac556-7316-478e-a2cf-0863e3b01f18'} removed Sep 04 01:21:36.870920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["547531f3-dc28-448d-89ce-0f24e3bdaf1b","delete","tap20940f6e-c5",36,["map",[["attached-mac","fa:16:3e:bc:27:a2"],["iface-id","20940f6e-c5ec-497b-b144-a180350e4857"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107812) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 04 01:21:36.878689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port removal failed for set() {{(pid=107812) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 04 01:21:36.879155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] net_uuid None not managed by VLAN manager Sep 04 01:21:36.879792 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:743 - treat_devices_removed completed in 0.106 Sep 04 01:21:36.880083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:743 - ports processed. Elapsed:0.122 Sep 04 01:21:36.880412 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:743 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 2}}. Elapsed:0.122 Sep 04 01:21:37.096961 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-7663cf12-ff29-4d63-9f9f-bd8afe415334 admin admin] Resource Port deleted: 20940f6e-c5ec-497b-b144-a180350e4857 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:21:37.097555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-7663cf12-ff29-4d63-9f9f-bd8afe415334 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-67602'] for Port (20940f6e-c5ec-497b-b144-a180350e4857), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:21:37.151022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-df3a34cf-1350-4bc2-b02f-e4d9cc65c332 None None] Resource Port deleted: 20940f6e-c5ec-497b-b144-a180350e4857 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:21:37.151432 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-df3a34cf-1350-4bc2-b02f-e4d9cc65c332 None None] Skipped duplicate delete event for 20940f6e-c5ec-497b-b144-a180350e4857 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:209}} Sep 04 01:21:37.369093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-7663cf12-ff29-4d63-9f9f-bd8afe415334 admin admin] Resource Network deleted: 41b67d38-e689-45bb-a406-6607a99ed49b {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:21:37.369544 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-7663cf12-ff29-4d63-9f9f-bd8afe415334 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-1048533'] for Network (41b67d38-e689-45bb-a406-6607a99ed49b), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:21:37.910428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-46cf1211-0e0c-4b9a-9e95-56939e18fd5a admin admin] Resource SecurityGroup deleted: 36f6ec18-1e64-4839-9f90-49478f98ae2a {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:21:37.910812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-46cf1211-0e0c-4b9a-9e95-56939e18fd5a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (36f6ec18-1e64-4839-9f90-49478f98ae2a), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:21:37.911765 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46cf1211-0e0c-4b9a-9e95-56939e18fd5a admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('36f6ec18-1e64-4839-9f90-49478f98ae2a',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:21:37.925510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-46cf1211-0e0c-4b9a-9e95-56939e18fd5a admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('36f6ec18-1e64-4839-9f90-49478f98ae2a',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:21:37.925947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-46cf1211-0e0c-4b9a-9e95-56939e18fd5a admin admin] Resource SecurityGroupRule deleted: 34ab7f34-ef77-4b0c-97bd-62402bb4214a {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:21:37.926555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-46cf1211-0e0c-4b9a-9e95-56939e18fd5a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (34ab7f34-ef77-4b0c-97bd-62402bb4214a), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:21:37.927190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-46cf1211-0e0c-4b9a-9e95-56939e18fd5a admin admin] Security group rule updated ['36f6ec18-1e64-4839-9f90-49478f98ae2a'] Sep 04 01:21:37.928002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-46cf1211-0e0c-4b9a-9e95-56939e18fd5a admin admin] Resource SecurityGroupRule deleted: af87b511-30d8-43b7-8b71-9dfcde73a7c1 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:21:37.928357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-46cf1211-0e0c-4b9a-9e95-56939e18fd5a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (af87b511-30d8-43b7-8b71-9dfcde73a7c1), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:21:37.929293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-46cf1211-0e0c-4b9a-9e95-56939e18fd5a admin admin] Security group rule updated ['36f6ec18-1e64-4839-9f90-49478f98ae2a'] Sep 04 01:21:37.929726 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-46cf1211-0e0c-4b9a-9e95-56939e18fd5a admin admin] Resource SecurityGroupRule deleted: cdd6c075-f08b-44c9-b98c-3accbc29b0a4 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:21:37.932976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-46cf1211-0e0c-4b9a-9e95-56939e18fd5a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (cdd6c075-f08b-44c9-b98c-3accbc29b0a4), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:21:37.932976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-46cf1211-0e0c-4b9a-9e95-56939e18fd5a admin admin] Security group rule updated ['36f6ec18-1e64-4839-9f90-49478f98ae2a'] Sep 04 01:21:37.932976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-46cf1211-0e0c-4b9a-9e95-56939e18fd5a admin admin] Resource SecurityGroupRule deleted: e1751ec9-022c-4598-a2c7-12e568aa1dfc {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:21:37.932976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-46cf1211-0e0c-4b9a-9e95-56939e18fd5a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (e1751ec9-022c-4598-a2c7-12e568aa1dfc), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:21:37.932976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-46cf1211-0e0c-4b9a-9e95-56939e18fd5a admin admin] Security group rule updated ['36f6ec18-1e64-4839-9f90-49478f98ae2a'] Sep 04 01:21:38.758605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:744 started Sep 04 01:21:38.776729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5991,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=153000000,duration_sec=1508,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:21:38.776729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:21:38.776729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:744 - starting polling. Elapsed:0.004 Sep 04 01:21:38.776729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-973425'] for ovsdb (None), after_read {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:21:38.777163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xeade5993,OFPFlowMod(buffer_id=4294967295,command=3,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 36}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:21:38.777163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:744 - port information retrieved. Elapsed:0.008 Sep 04 01:21:38.777163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Starting to process devices in:{'current': {'3fa24970-97a7-4f46-ac55-0b24323fa402', '89aa06b4-bbf1-40c2-bb48-500c3aecdf48', '85e5ae40-74c8-44fd-a057-a6dcb2b1601c', 'ca102ce7-433c-4029-aabf-33d944165ff1'}, 'added': set(), 'removed': {'20940f6e-c5ec-497b-b144-a180350e4857'}, 'updated': set(), 're_added': set()} {{(pid=107812) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 04 01:21:38.777163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:744 - agent port security group processed in 0.000 Sep 04 01:21:38.777586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Configuration for devices up [] and devices down [] completed. Sep 04 01:21:38.777586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Remove device filter for {'20940f6e-c5ec-497b-b144-a180350e4857'} Sep 04 01:21:38.777586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.common.ovs_lib [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Processing 4 OpenFlow rules. {{(pid=107812) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 04 01:21:38.807614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG oslo.privsep.daemon [-] privsep: reply[375d0c74-af5c-4710-9f6e-f11272fc2dd7]: (4, ('', '', 0)) {{(pid=109513) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 04 01:21:38.808207 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Ports {'20940f6e-c5ec-497b-b144-a180350e4857'} removed Sep 04 01:21:38.834316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Port removal failed for set() {{(pid=107812) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 04 01:21:38.834744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Reclaiming vlan = 14 from net-id = 41b67d38-e689-45bb-a406-6607a99ed49b, seg-id = 199 Sep 04 01:21:38.837543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x1fd38c1d,OFPFlowMod(buffer_id=4294967295,command=3,cookie=6561907047025962751,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4110}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:21:38.839856 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xeade5995,OFPFlowMod(buffer_id=4294967295,command=3,cookie=6887031442322345889,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4295}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:21:38.840181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] process_network_ports - iteration:744 - treat_devices_removed completed in 0.072 Sep 04 01:21:38.840476 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:744 - ports processed. Elapsed:0.082 Sep 04 01:21:38.840806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:744 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 1}}. Elapsed:0.082 Sep 04 01:21:38.901984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-2ffe35c8-5168-438f-a70a-70a67cd844b3 admin admin] Resource SecurityGroup deleted: d4c8d9f7-49b7-4890-a7c9-8be978bb8b89 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:21:38.902618 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-2ffe35c8-5168-438f-a70a-70a67cd844b3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-68339'] for SecurityGroup (d4c8d9f7-49b7-4890-a7c9-8be978bb8b89), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:21:38.902938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ffe35c8-5168-438f-a70a-70a67cd844b3 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('d4c8d9f7-49b7-4890-a7c9-8be978bb8b89',)}} {{(pid=107812) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 04 01:21:38.920325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-2ffe35c8-5168-438f-a70a-70a67cd844b3 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('d4c8d9f7-49b7-4890-a7c9-8be978bb8b89',)))} {{(pid=107812) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:88}} Sep 04 01:21:38.920729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-2ffe35c8-5168-438f-a70a-70a67cd844b3 admin admin] Resource SecurityGroupRule deleted: 8a6303a4-02b9-43cd-8546-7abd98c8baf2 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:21:38.921133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-2ffe35c8-5168-438f-a70a-70a67cd844b3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (8a6303a4-02b9-43cd-8546-7abd98c8baf2), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:21:38.921475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-2ffe35c8-5168-438f-a70a-70a67cd844b3 admin admin] Security group rule updated ['d4c8d9f7-49b7-4890-a7c9-8be978bb8b89'] Sep 04 01:21:38.921915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-2ffe35c8-5168-438f-a70a-70a67cd844b3 admin admin] Resource SecurityGroupRule deleted: 8be93b85-f75d-4090-a333-58f88072f8d6 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:21:38.922266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-2ffe35c8-5168-438f-a70a-70a67cd844b3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (8be93b85-f75d-4090-a333-58f88072f8d6), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:21:38.922586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-2ffe35c8-5168-438f-a70a-70a67cd844b3 admin admin] Security group rule updated ['d4c8d9f7-49b7-4890-a7c9-8be978bb8b89'] Sep 04 01:21:38.923005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-2ffe35c8-5168-438f-a70a-70a67cd844b3 admin admin] Resource SecurityGroupRule deleted: e0021c33-6af7-4658-bc90-0fa5317382e3 {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:21:38.923347 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-2ffe35c8-5168-438f-a70a-70a67cd844b3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (e0021c33-6af7-4658-bc90-0fa5317382e3), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:21:38.923888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-2ffe35c8-5168-438f-a70a-70a67cd844b3 admin admin] Security group rule updated ['d4c8d9f7-49b7-4890-a7c9-8be978bb8b89'] Sep 04 01:21:38.924507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.resource_cache [None req-2ffe35c8-5168-438f-a70a-70a67cd844b3 admin admin] Resource SecurityGroupRule deleted: f5442e18-9b79-43aa-b293-2ec77fdf6a5b {{(pid=107812) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:205}} Sep 04 01:21:38.924853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron_lib.callbacks.manager [None req-2ffe35c8-5168-438f-a70a-70a67cd844b3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-67584'] for SecurityGroupRule (f5442e18-9b79-43aa-b293-2ec77fdf6a5b), after_delete {{(pid=107812) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 04 01:21:38.925203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.agent.securitygroups_rpc [None req-2ffe35c8-5168-438f-a70a-70a67cd844b3 admin admin] Security group rule updated ['d4c8d9f7-49b7-4890-a7c9-8be978bb8b89'] Sep 04 01:21:40.759075 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:745 started Sep 04 01:21:40.761624 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5997,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=153000000,duration_sec=1510,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:21:40.762189 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:21:40.762545 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:745 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:21:42.759450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:746 started Sep 04 01:21:42.761974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5999,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=153000000,duration_sec=1512,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:21:42.762536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:21:42.762886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:746 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:21:44.760013 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:747 started Sep 04 01:21:44.762267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade599b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=154000000,duration_sec=1514,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:21:44.762822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:21:44.763162 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:747 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:21:46.761134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:748 started Sep 04 01:21:46.763690 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade599d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=155000000,duration_sec=1516,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:21:46.764259 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:21:46.764611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:748 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:21:48.762106 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:749 started Sep 04 01:21:48.764375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade599f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=156000000,duration_sec=1518,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:21:48.764931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:21:48.765372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:749 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:21:50.763095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:750 started Sep 04 01:21:50.765960 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade59a1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=158000000,duration_sec=1520,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:21:50.766528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:21:50.766882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:750 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:21:52.764469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:751 started Sep 04 01:21:52.767461 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade59a3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=158000000,duration_sec=1522,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:21:52.768014 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:21:52.768432 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:751 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 04 01:21:54.764755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:752 started Sep 04 01:21:54.767160 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade59a5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=159000000,duration_sec=1524,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:21:54.767721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:21:54.768067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:752 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:21:56.766159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:753 started Sep 04 01:21:56.768515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade59a7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=160000000,duration_sec=1526,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:21:56.769099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:21:56.769464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:753 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:21:58.767596 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:754 started Sep 04 01:21:58.770215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade59a9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=162000000,duration_sec=1528,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:21:58.770781 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:21:58.771132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:754 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:22:00.768220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:755 started Sep 04 01:22:00.770627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade59ab,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=162000000,duration_sec=1530,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:22:00.771191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:22:00.771541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:755 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:22:02.769783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:756 started Sep 04 01:22:02.772208 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade59ad,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=164000000,duration_sec=1532,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:22:02.772777 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:22:02.773170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:756 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:22:04.770349 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:757 started Sep 04 01:22:04.772744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade59af,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=164000000,duration_sec=1534,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:22:04.773329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:22:04.773677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:757 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:22:06.771667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:758 started Sep 04 01:22:06.773970 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade59b1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=166000000,duration_sec=1536,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:22:06.774547 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:22:06.774895 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:758 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:22:08.772264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:759 started Sep 04 01:22:08.774614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade59b3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=166000000,duration_sec=1538,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:22:08.775191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:22:08.775598 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:759 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:22:10.773692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:760 started Sep 04 01:22:10.776584 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade59b5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=168000000,duration_sec=1540,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:22:10.777165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:22:10.777524 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:760 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:22:12.774515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:761 started Sep 04 01:22:12.776825 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade59b7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=168000000,duration_sec=1542,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:22:12.777410 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:22:12.777760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:761 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:22:14.775933 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:762 started Sep 04 01:22:14.778771 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade59b9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=170000000,duration_sec=1544,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:22:14.778892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:22:14.779229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:762 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:22:16.776818 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:763 started Sep 04 01:22:16.779218 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade59bb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=171000000,duration_sec=1546,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:22:16.779879 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:22:16.780232 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:763 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:22:18.777477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:764 started Sep 04 01:22:18.779767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade59bd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=171000000,duration_sec=1548,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:22:18.780327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:22:18.780675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:764 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:22:20.778740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:765 started Sep 04 01:22:20.781498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade59bf,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=173000000,duration_sec=1550,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:22:20.782069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:22:20.782420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:765 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:22:22.779658 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:766 started Sep 04 01:22:22.782019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade59c1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=174000000,duration_sec=1552,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:22:22.782570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:22:22.782941 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:766 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:22:24.781283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:767 started Sep 04 01:22:24.783863 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade59c3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=175000000,duration_sec=1554,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:22:24.784416 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:22:24.784788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:767 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:22:26.781858 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:768 started Sep 04 01:22:26.784354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade59c5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=176000000,duration_sec=1556,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:22:26.784909 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:22:26.785283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:768 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:22:28.782783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:769 started Sep 04 01:22:28.785294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade59c7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=177000000,duration_sec=1558,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:22:28.785859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:22:28.786213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:769 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:22:30.783636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:770 started Sep 04 01:22:30.786203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade59c9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=178000000,duration_sec=1560,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:22:30.786759 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:22:30.787107 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:770 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:22:32.784961 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:771 started Sep 04 01:22:32.787342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade59cb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=179000000,duration_sec=1562,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:22:32.787902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:22:32.788272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:771 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:22:34.786389 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:772 started Sep 04 01:22:34.789064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade59cd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=180000000,duration_sec=1564,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:22:34.789651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:22:34.790596 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:772 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:22:36.788307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:773 started Sep 04 01:22:36.791249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade59cf,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=182000000,duration_sec=1566,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:22:36.791806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:22:36.792154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:773 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:22:38.788996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:774 started Sep 04 01:22:38.791471 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade59d1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=183000000,duration_sec=1568,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:22:38.792031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:22:38.792380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:774 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:22:40.790485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:775 started Sep 04 01:22:40.792846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade59d3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=184000000,duration_sec=1570,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:22:40.793430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:22:40.793779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:775 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:22:42.791366 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:776 started Sep 04 01:22:42.793736 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade59d5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=185000000,duration_sec=1572,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:22:42.794336 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:22:42.794685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:776 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:22:44.792195 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:777 started Sep 04 01:22:44.794507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade59d7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=186000000,duration_sec=1574,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:22:44.795062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:22:44.795436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:777 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:22:46.793397 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:778 started Sep 04 01:22:46.795701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade59d9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=187000000,duration_sec=1576,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:22:46.796259 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:22:46.796604 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:778 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:22:48.794377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:779 started Sep 04 01:22:48.796708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade59db,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=188000000,duration_sec=1578,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:22:48.797320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:22:48.797675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:779 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:22:50.794908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:780 started Sep 04 01:22:50.797224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade59dd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=189000000,duration_sec=1580,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:22:50.797781 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:22:50.798126 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:780 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:22:52.795954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:781 started Sep 04 01:22:52.798331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade59df,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=190000000,duration_sec=1582,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:22:52.798889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:22:52.799236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:781 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:22:54.796713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:782 started Sep 04 01:22:54.799127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade59e1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=191000000,duration_sec=1584,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:22:54.799685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:22:54.800034 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:782 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:22:56.797665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:783 started Sep 04 01:22:56.800703 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade59e3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=192000000,duration_sec=1586,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:22:56.801297 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:22:56.801784 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:783 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:22:58.798622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:784 started Sep 04 01:22:58.800949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade59e5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=193000000,duration_sec=1588,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:22:58.801540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:22:58.801900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:784 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:23:00.799710 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:785 started Sep 04 01:23:00.802149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade59e7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=194000000,duration_sec=1590,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:23:00.802714 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:23:00.803066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:785 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:23:02.800879 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:786 started Sep 04 01:23:02.803244 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade59e9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=195000000,duration_sec=1592,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:23:02.803830 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:23:02.804219 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:786 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:23:04.802169 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:787 started Sep 04 01:23:04.804589 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade59eb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=196000000,duration_sec=1594,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:23:04.805173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:23:04.805522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:787 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:23:06.803477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:788 started Sep 04 01:23:06.806263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade59ed,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=197000000,duration_sec=1596,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:23:06.806843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:23:06.807732 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:788 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:23:08.804779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:789 started Sep 04 01:23:08.807870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade59ef,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=199000000,duration_sec=1598,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:23:08.808427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:23:08.809033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:789 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:23:10.805827 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:790 started Sep 04 01:23:10.808316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade59f1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=200000000,duration_sec=1600,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:23:10.808871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:23:10.809249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:790 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:23:12.807335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:791 started Sep 04 01:23:12.809908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade59f3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=201000000,duration_sec=1602,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:23:12.814253 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:23:12.814253 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:791 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:23:14.808016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:792 started Sep 04 01:23:14.810472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade59f5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=202000000,duration_sec=1604,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:23:14.814433 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:23:14.814433 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:792 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:23:16.808803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:793 started Sep 04 01:23:16.811250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade59f7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=203000000,duration_sec=1606,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:23:16.811840 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:23:16.812199 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:793 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:23:18.809878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:794 started Sep 04 01:23:18.812353 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade59f9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=204000000,duration_sec=1608,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:23:18.812981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:23:18.813387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:794 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:23:20.810530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:795 started Sep 04 01:23:20.812902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade59fb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=205000000,duration_sec=1610,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:23:20.813536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:23:20.813883 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:795 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:23:22.811766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:796 started Sep 04 01:23:22.814205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade59fd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=206000000,duration_sec=1612,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:23:22.814795 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:23:22.815151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:796 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:23:24.812494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:797 started Sep 04 01:23:24.814916 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade59ff,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=206000000,duration_sec=1614,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:23:24.815514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:23:24.815864 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:797 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:23:26.813153 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:798 started Sep 04 01:23:26.817762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a01,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=207000000,duration_sec=1616,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:23:26.817762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:23:26.817762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:798 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:23:28.813857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:799 started Sep 04 01:23:28.816370 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a03,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=208000000,duration_sec=1618,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:23:28.816935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:23:28.817324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:799 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:23:30.815268 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:800 started Sep 04 01:23:30.818050 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a05,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=209000000,duration_sec=1620,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:23:30.818649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:23:30.818996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:800 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:23:32.815865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:801 started Sep 04 01:23:32.818317 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a07,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=210000000,duration_sec=1622,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:23:32.818877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:23:32.819225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:801 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:23:34.817366 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:802 started Sep 04 01:23:34.819807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a09,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=211000000,duration_sec=1624,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:23:34.820369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:23:34.820752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:802 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:23:36.817866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:803 started Sep 04 01:23:36.820337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a0b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=212000000,duration_sec=1626,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:23:36.820910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:23:36.821328 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:803 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:23:38.819398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:804 started Sep 04 01:23:38.823550 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a0d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=213000000,duration_sec=1628,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:23:38.823550 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:23:38.823804 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:804 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:23:40.820228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:805 started Sep 04 01:23:40.823610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a0f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=215000000,duration_sec=1630,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:23:40.824202 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:23:40.824558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:805 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 04 01:23:42.821023 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:806 started Sep 04 01:23:42.823639 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a11,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=215000000,duration_sec=1632,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:23:42.824210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:23:42.824562 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:806 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:23:44.822418 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:807 started Sep 04 01:23:44.825506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a13,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=216000000,duration_sec=1634,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:23:44.826097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:23:44.826448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:807 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:23:46.823242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:808 started Sep 04 01:23:46.826290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a15,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=218000000,duration_sec=1636,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:23:46.826858 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:23:46.827214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:808 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:23:48.824784 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:809 started Sep 04 01:23:48.827233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a17,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=219000000,duration_sec=1638,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:23:48.827791 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:23:48.828143 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:809 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:23:50.826432 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:810 started Sep 04 01:23:50.828930 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a19,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=220000000,duration_sec=1640,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:23:50.829541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:23:50.829901 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:810 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:23:52.826886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:811 started Sep 04 01:23:52.829404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a1b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=221000000,duration_sec=1642,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:23:52.829974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:23:52.830325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:811 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:23:54.827991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:812 started Sep 04 01:23:54.830516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a1d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=222000000,duration_sec=1644,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:23:54.831081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:23:54.831432 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:812 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:23:56.829568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:813 started Sep 04 01:23:56.832035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a1f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=224000000,duration_sec=1646,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:23:56.832606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:23:56.833103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:813 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:23:58.831015 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:814 started Sep 04 01:23:58.833454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a21,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=225000000,duration_sec=1648,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:23:58.834019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:23:58.834368 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:814 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:24:00.832456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:815 started Sep 04 01:24:00.834857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a23,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=226000000,duration_sec=1650,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:24:00.835420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:24:00.835789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:815 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:24:02.833917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:816 started Sep 04 01:24:02.836399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a25,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=228000000,duration_sec=1652,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:24:02.837140 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:24:02.837668 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:816 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:24:04.834921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:817 started Sep 04 01:24:04.837392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a27,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=229000000,duration_sec=1654,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:24:04.837951 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:24:04.838320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:817 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:24:06.836445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:818 started Sep 04 01:24:06.843621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a29,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=230000000,duration_sec=1656,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:24:06.844206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:24:06.844555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:818 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 04 01:24:08.837634 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:819 started Sep 04 01:24:08.840085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a2b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=232000000,duration_sec=1658,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:24:08.840647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:24:08.840998 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:819 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:24:10.838868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:820 started Sep 04 01:24:10.841293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a2d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=233000000,duration_sec=1660,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:24:10.841994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:24:10.842340 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:820 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:24:12.840006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:821 started Sep 04 01:24:12.842456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a2f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=234000000,duration_sec=1662,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:24:12.843012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:24:12.843360 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:821 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:24:14.841535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:822 started Sep 04 01:24:14.843958 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a31,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=236000000,duration_sec=1664,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:24:14.844511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:24:14.844971 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:822 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:24:16.842424 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:823 started Sep 04 01:24:16.844917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a33,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=236000000,duration_sec=1666,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:24:16.845496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:24:16.845842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:823 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:24:18.843360 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:824 started Sep 04 01:24:18.845851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a35,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=237000000,duration_sec=1668,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:24:18.846419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:24:18.846772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:824 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:24:20.844499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:825 started Sep 04 01:24:20.846967 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a37,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=239000000,duration_sec=1670,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:24:20.847528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:24:20.847871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:825 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:24:22.845645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:826 started Sep 04 01:24:22.848101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a39,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=240000000,duration_sec=1672,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:24:22.848664 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:24:22.849013 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:826 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:24:24.846367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:827 started Sep 04 01:24:24.848938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a3b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=240000000,duration_sec=1674,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:24:24.849534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:24:24.849908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:827 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:24:26.847076 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:828 started Sep 04 01:24:26.849572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a3d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=241000000,duration_sec=1676,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:24:26.850142 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:24:26.850493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:828 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:24:28.848123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:829 started Sep 04 01:24:28.851205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a3f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=242000000,duration_sec=1678,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:24:28.851812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:24:28.852165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:829 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:24:30.848876 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:830 started Sep 04 01:24:30.851660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a41,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=243000000,duration_sec=1680,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:24:30.852250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:24:30.852597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:830 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:24:32.849630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:831 started Sep 04 01:24:32.852075 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a43,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=244000000,duration_sec=1682,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:24:32.852637 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:24:32.852987 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:831 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:24:34.851123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:832 started Sep 04 01:24:34.853531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a45,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=245000000,duration_sec=1684,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:24:34.854086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:24:34.854428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:832 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:24:36.852293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:833 started Sep 04 01:24:36.854852 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a47,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=246000000,duration_sec=1686,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:24:36.855423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:24:36.855775 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:833 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:24:38.853285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:834 started Sep 04 01:24:38.855730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a49,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=247000000,duration_sec=1688,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:24:38.856320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:24:38.856671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:834 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:24:40.853869 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:835 started Sep 04 01:24:40.860948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a4b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=248000000,duration_sec=1690,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:24:40.861570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:24:40.861922 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:835 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 04 01:24:42.854624 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:836 started Sep 04 01:24:42.857634 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a4d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=249000000,duration_sec=1692,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:24:42.858222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:24:42.858570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:836 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:24:44.855988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:837 started Sep 04 01:24:44.858491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a4f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=250000000,duration_sec=1694,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:24:44.859046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:24:44.859395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:837 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:24:46.857747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:838 started Sep 04 01:24:46.860321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a51,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=252000000,duration_sec=1696,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:24:46.860907 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:24:46.861288 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:838 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:24:48.858159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:839 started Sep 04 01:24:48.860442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a53,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=252000000,duration_sec=1698,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:24:48.861006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:24:48.861379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:839 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:24:50.859766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:840 started Sep 04 01:24:50.862653 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a55,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=254000000,duration_sec=1700,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:24:50.863210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:24:50.863562 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:840 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:24:52.861157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:841 started Sep 04 01:24:52.863952 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a57,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=255000000,duration_sec=1702,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:24:52.864526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:24:52.864879 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:841 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:24:54.861645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:842 started Sep 04 01:24:54.864233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a59,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=256000000,duration_sec=1704,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:24:54.864801 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:24:54.865192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:842 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:24:56.862809 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:843 started Sep 04 01:24:56.865231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a5b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=257000000,duration_sec=1706,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:24:56.865795 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:24:56.866146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:843 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:24:58.863392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:844 started Sep 04 01:24:58.865695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a5d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=257000000,duration_sec=1708,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:24:58.866261 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:24:58.866611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:844 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:25:00.864697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:845 started Sep 04 01:25:00.867174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a5f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=259000000,duration_sec=1710,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:25:00.867739 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:25:00.868091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:845 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:25:02.865989 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:846 started Sep 04 01:25:02.868454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a61,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=260000000,duration_sec=1712,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:25:02.869016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:25:02.869404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:846 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:25:04.867105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:847 started Sep 04 01:25:04.869586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a63,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=261000000,duration_sec=1714,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:25:04.870146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:25:04.870496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:847 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:25:06.868125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:848 started Sep 04 01:25:06.870811 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a65,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=262000000,duration_sec=1716,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:25:06.871403 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:25:06.871789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:848 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:25:08.868994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:849 started Sep 04 01:25:08.871934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a67,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=264000000,duration_sec=1718,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:25:08.872510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:25:08.873030 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:849 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:25:10.869759 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:850 started Sep 04 01:25:10.872817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a69,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=264000000,duration_sec=1720,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:25:10.873417 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:25:10.874000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:850 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:25:12.870716 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:851 started Sep 04 01:25:12.874550 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a6b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=265000000,duration_sec=1722,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:25:12.875111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:25:12.875461 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:851 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 04 01:25:14.872516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:852 started Sep 04 01:25:14.875347 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a6d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=267000000,duration_sec=1724,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:25:14.875899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:25:14.876244 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:852 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:25:16.873888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:853 started Sep 04 01:25:16.876309 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a6f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=268000000,duration_sec=1726,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:25:16.876870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:25:16.877258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:853 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:25:18.874795 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:854 started Sep 04 01:25:18.877061 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a71,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=269000000,duration_sec=1728,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:25:18.877652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:25:18.878005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:854 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:25:20.875527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:855 started Sep 04 01:25:20.878231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a73,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=270000000,duration_sec=1730,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:25:20.878796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:25:20.879148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:855 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:25:22.876895 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:856 started Sep 04 01:25:22.879414 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a75,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=271000000,duration_sec=1732,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:25:22.879981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:25:22.880331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:856 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:25:24.878233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:857 started Sep 04 01:25:24.880967 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a77,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=272000000,duration_sec=1734,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:25:24.881558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:25:24.881911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:857 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:25:26.879752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:858 started Sep 04 01:25:26.882192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a79,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=274000000,duration_sec=1736,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:25:26.882759 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:25:26.883105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:858 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:25:28.881081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:859 started Sep 04 01:25:28.883309 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a7b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=275000000,duration_sec=1738,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:25:28.883865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:25:28.884269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:859 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:25:30.882329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:860 started Sep 04 01:25:30.884927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a7d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=276000000,duration_sec=1740,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:25:30.885525 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:25:30.885875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:860 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:25:32.883423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:861 started Sep 04 01:25:32.885822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a7f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=277000000,duration_sec=1742,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:25:32.886381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:25:32.886724 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:861 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:25:34.884588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:862 started Sep 04 01:25:34.886929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a81,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=279000000,duration_sec=1744,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:25:34.887486 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:25:34.887835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:862 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:25:36.885099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:863 started Sep 04 01:25:36.888654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a83,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=279000000,duration_sec=1746,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:25:36.889767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:25:36.890120 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:863 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 04 01:25:38.886202 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:864 started Sep 04 01:25:38.892514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a85,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=280000000,duration_sec=1748,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:25:38.894045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:25:38.894396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:864 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 04 01:25:40.886822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:865 started Sep 04 01:25:40.890340 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a87,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=281000000,duration_sec=1750,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:25:40.890904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:25:40.891256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:865 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 04 01:25:42.887431 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:866 started Sep 04 01:25:42.889980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a89,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=281000000,duration_sec=1752,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:25:42.890914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:25:42.891285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:866 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:25:44.888779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:867 started Sep 04 01:25:44.891126 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a8b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=283000000,duration_sec=1754,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:25:44.892170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:25:44.892553 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:867 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:25:46.889855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:868 started Sep 04 01:25:46.892149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a8d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=284000000,duration_sec=1756,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:25:46.892709 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:25:46.893059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:868 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:25:48.890554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:869 started Sep 04 01:25:48.893195 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a8f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=284000000,duration_sec=1758,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:25:48.893779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:25:48.894123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:869 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:25:50.891391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:870 started Sep 04 01:25:50.893801 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a91,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=285000000,duration_sec=1760,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:25:50.894362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:25:50.894713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:870 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:25:52.891944 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:871 started Sep 04 01:25:52.895132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a93,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=286000000,duration_sec=1762,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:25:52.895963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:25:52.896459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:871 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 04 01:25:54.893528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:872 started Sep 04 01:25:54.895813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a95,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=287000000,duration_sec=1764,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:25:54.896446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:25:54.896791 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:872 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:25:56.894513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:873 started Sep 04 01:25:56.897424 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a97,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=289000000,duration_sec=1766,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:25:56.897992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:25:56.898338 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:873 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:25:58.895543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:874 started Sep 04 01:25:58.898227 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a99,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=290000000,duration_sec=1768,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:25:58.898790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:25:58.899172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:874 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:26:00.896820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:875 started Sep 04 01:26:00.899885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a9b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=292000000,duration_sec=1770,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:26:00.900440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:26:00.900784 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:875 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:26:02.898494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:876 started Sep 04 01:26:02.900234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a9d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=291000000,duration_sec=1772,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:26:02.902442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:26:02.902442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:876 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:26:04.898774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:877 started Sep 04 01:26:04.901164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5a9f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=293000000,duration_sec=1774,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:26:04.902094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:26:04.902442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:877 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:26:06.899786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:878 started Sep 04 01:26:06.902210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5aa1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=294000000,duration_sec=1776,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:26:06.902791 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:26:06.903136 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:878 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:26:08.901054 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:879 started Sep 04 01:26:08.903455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5aa3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=295000000,duration_sec=1778,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:26:08.904042 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:26:08.904395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:879 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:26:10.902247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:880 started Sep 04 01:26:10.904823 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5aa5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=296000000,duration_sec=1780,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:26:10.905447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:26:10.905803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:880 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:26:12.907605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:881 started Sep 04 01:26:12.909945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5aa7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=302000000,duration_sec=1782,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:26:12.910506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:26:12.910882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:881 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 04 01:26:14.903854 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:882 started Sep 04 01:26:14.906218 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5aa9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=298000000,duration_sec=1784,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:26:14.906935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:26:14.907281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:882 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:26:16.904935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:883 started Sep 04 01:26:16.908026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5aab,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=299000000,duration_sec=1786,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:26:16.908595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:26:16.908943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:883 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:26:18.905398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:884 started Sep 04 01:26:18.908171 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5aad,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=299000000,duration_sec=1788,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:26:18.908724 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:26:18.909092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:884 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:26:20.905892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:885 started Sep 04 01:26:20.908837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5aaf,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=300000000,duration_sec=1790,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:26:20.909424 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:26:20.909777 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:885 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:26:22.907481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:886 started Sep 04 01:26:22.909828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5ab1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=301000000,duration_sec=1792,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:26:22.910386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:26:22.910732 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:886 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:26:24.908479 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:887 started Sep 04 01:26:24.910947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5ab3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=303000000,duration_sec=1794,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:26:24.911552 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:26:24.911893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:887 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:26:26.909247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:888 started Sep 04 01:26:26.911968 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5ab5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=304000000,duration_sec=1796,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:26:26.912539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:26:26.912880 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:888 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:26:28.909735 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:889 started Sep 04 01:26:28.912557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5ab7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=304000000,duration_sec=1798,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:26:28.913127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:26:28.913474 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:889 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:26:30.910867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:890 started Sep 04 01:26:30.913609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5ab9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=305000000,duration_sec=1800,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:26:30.914159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:26:30.914502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:890 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:26:32.911669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:891 started Sep 04 01:26:32.914388 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5abb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=306000000,duration_sec=1802,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:26:32.914948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:26:32.915296 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:891 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:26:34.912404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:892 started Sep 04 01:26:34.914782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5abd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=306000000,duration_sec=1804,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:26:34.919452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:26:34.919452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:892 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:26:36.913234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:893 started Sep 04 01:26:36.915875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5abf,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=308000000,duration_sec=1806,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:26:36.916430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:26:36.916776 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:893 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:26:38.914599 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:894 started Sep 04 01:26:38.917371 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5ac1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=309000000,duration_sec=1808,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:26:38.917930 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:26:38.918277 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:894 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:26:40.915525 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:895 started Sep 04 01:26:40.918192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5ac3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=310000000,duration_sec=1810,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:26:40.918745 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:26:40.919092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:895 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:26:42.916704 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:896 started Sep 04 01:26:42.920012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5ac5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=312000000,duration_sec=1812,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:26:42.920575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:26:42.920924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:896 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:26:44.917529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:897 started Sep 04 01:26:44.921712 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5ac7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=311000000,duration_sec=1814,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:26:44.925535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:26:44.925535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:897 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 04 01:26:46.917954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:898 started Sep 04 01:26:46.920289 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5ac9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=312000000,duration_sec=1816,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:26:46.921211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:26:46.921554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:898 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:26:48.919281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:899 started Sep 04 01:26:48.922560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5acb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=314000000,duration_sec=1818,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:26:48.923859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:26:48.924212 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:899 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 04 01:26:50.920678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:900 started Sep 04 01:26:50.923512 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5acd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=315000000,duration_sec=1820,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:26:50.924064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:26:50.924405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:900 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 04 01:26:52.921837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:901 started Sep 04 01:26:52.924214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5acf,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=316000000,duration_sec=1822,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:26:52.924772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:26:52.925170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:901 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 04 01:26:54.922518 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:902 started Sep 04 01:26:54.924902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xeade5ad1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=6887031442322345889,duration_nsec=317000000,duration_sec=1824,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107812) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 04 01:26:54.925540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: DEBUG neutron.agent.linux.utils [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109575. {{(pid=107812) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 04 01:26:54.925882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107812]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-86c19d39-e1a5-4424-928d-276c22bcad15 None None] Agent rpc_loop - iteration:902 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004